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ABSTRACT 

Digraphs/ graphs and task analysis were used to map 
out the coatent structure of a programed text (SMSG) in elementary 
probability; mathematical structure vas operationally defined as the 
relationship between concepts within a set of abstract systems. Th-.^ 
word association technique (WA) and paragraph construction technique 
(PC) were used to measure the existing relations (cognitive 
structure) in S's memory with respect to the probability theory 
present in the text. The purpose of this study was to measure the 
influence of content structure (mathematical structure) of the text 
on the subjects' cognitive structure. Control and experimental Ss 
{W=181) were sixth-grade, eighth-grade and high-school (grades 9-12) 
students* Experimental Ss read the probability text while the others 
read a programed text unrelated to probability. Ss were pre- and 
posttested and given retention tests. Results indicated that the 
experimental Ss' measured cognitive structure highly resembled the 
text's content structure following instruction. The WA and PC test 
also appeared to be useful for formative evaluation of the programed 
text and gave different information than did achievement tests. (JP)h 
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CHAPrER 1 



The P.r'oblom, Piirponon of i.ho Sbud.y, 
Overview of the Study 

IdonlilM cnl.ion oP Uio Problem 

Durinf'*; 1:ho pnrt decade ina thematic curi-icula have been 
revi£5ed significantly in an effort: to provide students with a 
greater anderntandin^^ of mathematics. Curriculum developers 
have attempted to commimicate something more than algorithms 
and computational skills to the student (cf . Report of the 
Commission on Mathematics, 1959)- That is, the student also 
is expected to learn relationships among mathematical concepts. 
In short, one purpose of the nev/ curricula is to familiarize 
students v;ith the structiare of mathematics (Report of the 
Cambridge Conference, 1955)- 

This focus on mathematical structure led to the forma- 
tion of several curriculum groups. They wei'e charged with 
incorporating the structuxe of mathematics into the public 
school mathematics curricula. In discussing one of these 
groups, the School Mathematics Study Group, Begle (1971, p. 58) 
v/ri te s : 

...by paying careful attention to the structure 
of mathematics, the v;ay mathematical ideas fd.t 
togethor, rather than relying on intricate and 
ingouiour; computations, it was possible to solve 
difficult and important mathematical problems... . 
The importance of this change of emphasis from 
nngejnoun computations (.o basic concepts and the 
structure of mathematics gradually became clear. 

In spite of the emphasis in past years on the structure 
of mathematics, very little empirical work has been done con- 
cerning the communication of mathem.atical structure to the 
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f.^tudotit . Ono po:irvLblo ro^anon .for Uhir. puuci oT rof.5oarcli irj 
that irint'lioniMtii c,!(\.L rii:ructuro har. not been d''^ Pi nod opei'atiofi- . 
ally, Aiiotlior por^nible re^r-'>on ir. that the tlirust of curriculum 
revision ban bc':;ii toward, devolopmoiib i-athor bhon x-ofjoarch and 
c?valuatlon. Only j/ocGxihly havo a I'cw, nyntoinatic , ompirical 
ribvulier^ in inathcMTiati c.:n oducal;joii C^^.R. the I^'abional Longi- 
tudinal Study o^ Mathematical Abilities, School Mabheinaticr. 
Study Group) boon carried out. II' learrdiig mathematical 
structure ir; ixis iuiportant to mathematics education as leaders 
in the lield :-ur:r5ort, a definition of structui-e v/hich leads 
to empii'ical mothodr^ J'or ntndying r;tructuro are critical to 
the improvement of mathematics curricula. 

The purpor;e of this ctudy, in broad terms, ia to define 
what is meant b;/ f..;tructure in mathematics curricula and to 
investigate GOme methods for e>:amining structure in the cur- 
riculum and structure in the student':^ memory after instruction. 
Of peripheral focus in this study is the possible usefulness 
of ini'ormation gathered by the various procedures for curriculum 
evaluation, both formative and summative (Scriven, 1967)- The 
study itself is not a curriculum evaluation, but if the 
instruments and procedures used in the study yield information 
concerning the representation, communication and learning of 
mathematical structure then the instruments also should lend 
thomsclves to evaluatioti. 

Definition of the Research Problem 

Bogle (in preparation) states, "Wo consider mathe- 
matics to be a set of interrelated , abstract , symbolic systems . ^' 



flo ornphasir.or; M'lnt jimLhematical riLi'uctaj'o i:; a com'bjjiailon of 
within system :p(?latioiiwiiipB tmd. boLwoon r^.yrJ.om rcla tionchips. 
ShavelGon (1970? l) used a aimilor' {s,onernl derinition .for 
structure • 

. . . rrLT'Uctu;r;o in dc^Pijiod nr> an ar.:cninblaEo of 
JdontiifiablG oloinonto ajnd t;ho rolatJ. onnhipr:; 
bobv/ocri. thoP)0 oleinentG. St;ruct:uro may be 
objective and real or internal and subjective. 
In inlerpre ting literature on .structure, 
npecial attention will be paid to identiTying 
elements and stating how they are interrelated. 

Begle's discussion and Shavelson^s definition are sufficiently 
similar to indicate that Shavelcon's work may be relevant to 
the representation of mathematical structure. 

For the purposes of this study, mathematical structure 
is defined to be the relationships between concepts v/ithin a 
set of abstract systems. (Concepts may be represented by 
either symbols or v/ords.) Suppose v/e could get measures of 
structure in both the mathematics curriculum and in a student's 
memory after learning from the curriculum v/hich are consistent 
with our definition of mathematical structure. Comparison of 
the two representations of structure might provide some 
insight into the extent to which the goal of teaching mathe- 
matical structure has been achieved. 

Con ten f;truct\LT-e . V/hcn v;e nj^eak of the structure 
presented by a mathematics curriculurr. v/e rofer to v:hat 
Shavelson (1970) has termed content structu,re. Content 
structure is "the web of facts (v/ords, concepts), and their 
interrelations in a body of instructional material [Shavelson, 
1970, p. 9]." The problem, then, is to identify a method for 



ina.pi^ing the corjcepts and their inberrelatioj-JG in a mathematics 

curriculujA.' 'One possible method, applied by Shavelson (1970) ^ 

is the theory oi directed graphs. "This theory is concerned 

with patterns of relationships among pairs of abstract elements 

[Harary, Norman, and Cartwright, 1965, p. 2]." The theory of 

directed graphs, or more birielly, digraph bheory , 

...deals with abstract conXj.gurations called 
. digraphs, which consist ol' 'points ' and 'directed 
lines.' When these terms are given concrete 
referents, digraphs serve as mathematical models 
of empirical structures, and properties of 
digraphs reflect structural properties of the 
empirical world-. » . [Harary, et. al. , 1965^ P* v] . 

If vje allow conce;pts (words or symbols) to be represented by 
points and their interrelationships to be represented by lines, 
then all true statements about the obtained digraph are cor- 
respondly true of the empirical world. Digraph theory, then, 
provides a method for transferring v/ritten instruction into 
a structural representation consistent with our definition of 
mathematical structure." 

Jiopstein and Hanrieder (1956) and Shavelson (1970) 
have applied digraph theory to the analysis of content struc- 
ture. Shavelson (1970) developed one possible set of rules 
for transferring prose into a .digraph. He used the sentence 
as a unit of. analysis and separated it into its syntactical 
components. He then gave rules for relating various components 
of the sentence to the digraph. Shavelson (1970, p. 37) S^^-'^ 
the following example .from physics: 
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. • . '.rorco ir; bho product of niaoG and acceleration' 
and diagrammed an: 



uc t 



.Force I jr.; I pror 



o 



ma J 



I 

and 
I 
j 

accoloration 



..•The following digraph Tor F = MA resulted: 



roduct 




Force 



Ma BO ^^--^ — ^ Acceleration 
As Shavolson (197O) points out, digraph theory is only 
one possible way ol representing the structure presented by 
text (see BerelL-^oji (195^4) for a review of other alternatives). 
An equally plau.sible method for representing mrthematical 
structure would be the use of graph theory (Harary & Herman, 
1955) • Graph theory differs fror. digrar/n theor;/ in that non- 
directed lines ai^e used. A third method for representing 
content structure is task analysis (cf. Gagne , 1965) • This 
results in a logical hierarchy of concepts. Other alternatives, 
such as transformational grammar (Chomsky, 1955), might be 
used.. In this study, three methods of analysing content 
structure — digraph theory, graph theory, aj:d task analysis — 
v/ill be inve r:tiprated. 



Co^yii tive structure . Guirdculuin evaluators have used 
numoi'ous mobbed:.' in attempting to decide whether or not the 
goals of the curriculum have been achieved. Most evaluation 
instruments rely on achievement tests to assess the success 
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o.r a curi'lciiiiun. Jlowov<ir, \A\e L'rxcl) l\\txt fj c'vUdonl; can acid 
and r.ubtx-act door; not inipl^ .rjocessarily that tin) fijbude/Lb icj 
familiar with the rolabionship between addition and subtrac- 
tion. Various tests have been developed to determine if a 
student underrplandG these relationships. l*'or example, the 
National Longitudinal Study oJ' Matheinaticol Abilities (NLSMA) 
developed tests for foui'' cognitive levels (Romberg & V/ilson, 
1959) • The tests actually do not attempt to measure the learn- 
ing of mathematical structure, but pui'port to measure complexity 
levels of mental activities (Romberg & Wilson, 1959 )• IT the 
curriculum developer or mathematics educator actually desix'es 
the student to be familiar with a structure in mathematics, 
this objective needs to be defined in terms suitable for 
empirical investigation. Then the ovaluabor should determine 
the success of the curriculum in attaining this objective. 
"V/hen vje take so much care to develojj understanding and 
creativity in the student, it would be a pity to test his 
achievement only in terms of the mechanical skills and rote 
responses he has learned. [Cambridge Conference Report, 1953]." 

When v;e speak of structure in a student's memory, v;e 
refer to "cognitive structure." Cognitive structure is a 
"hypothetical construct referring to the organization (inter- 
relationships) of concepts in long-term memory [Shavelson, 
1970, p. 9]-" One method for examining cognitive structure is 
the technique of word association (WA) (cf. Deese, 1962, 1965; 
Johnson, 1964, 1965, 1967, 1969; Shavelson, 1970). With this 
method, the student is presented a concept in mathematics, 
for example, and asked to call forth as many other related 



iiui-bhomatlca]. co\]VA:])i\\ a^': lio ca.ti. ^Lhc^ rationale Tor UGiiig this 
niothod to crxainj.jKJ cop;n:ltivo nt.r.'uc larro .i.:'. f;;j.vnti hy JJooi^e 
p. 17^-0'* "a;.^::ocj.ationi--; cierivo ia whole or part Ironi the 
structures o.r cato[^orios o.l' the hujnar miml.^' According to 
Dcor;o (196P, i%!:0 cjricl Shavolr^oti (1970), [Am mcnnini;; oT wordrj 
ir; dorinod, in ? larf^j pai*t, by Lho orfjarjjzcd rela tiorir. among 
v/03xlf?. JohriL^on (1967) concurs thnt lear.nin[; f.)Ut)ject matter 
is, in part, interjialising rolaLionship:.. betv/eeii concepts. 

One v/a;y to examine the organis'-.at io.n of concepts in a 
studont's nie^jiioi'.Y is to compare the ovex'lap in responser. to 
various concopbr-;. ^'The underlying a:;8urnption is that the 
order of rer.noa.so .retrieval from long-term memory reflects at 
least a signi ficariit part ot the c-tructure v/ithin and hetv/een 
concepts [Shavelson, 1970, p. 6]." Since the problem at hand 
is to obtain a representation of the student's cognitive 
structure concerning mathematics, we are interested in how 
the student orgariizes the mathematical concepts- The WA 
technique I'oveals something about that organization. Deese 
(1962) took conce]:)ts v^hich had an underlying categoric struc- 
ture, collected V/A data, and vjas able to retrieve an inter- 
pretable, logically consistent structure from the V/A data. 
Thus the V/A method may be appropriate for investigating that 
jjortion of a student's cognitive structure concerning mathe- 
matics. 

Rothkopf and Thur-ner (1970, p. 85) observed that "the 
performance changes that result from experience in the verbal 
learning laboratory may [...] be quite untypical of the manner 
in which verbal performance is ordinarily modified by verbal 
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exporj.Giices in man." Thoy GugcoGt l;hal: wo nliould invGCtigate 

quanLitative indicators that rGscmble more closely normal 

language usago* I'his line of reaGoninfi; lod Kothkopf and 

Thurner to suggest a second method of investigating cognitive 

structure, namely the use of osr:ay i;rotocols. 

Techniques for Uie analysis of essay 
protocols are also applicable to the analysis 
of ii^structional text. As such they offer 
the posv.ibility of providing quantitative 
indicators of instructive e:>rperience and more 
powerful and realistic characterization of 
indei^cndent variables in instruction. [Eothkopf 
&. Thurner, 1970, pp. 88-89] . 

Since the wojkI association I.echniquo is not the only 

possible (and perhaps not the best) measure of the learning 

of mathematical structur-e, a second measure of cognitive 

structure v/ill be used in this study. l''ollov;ing a literature 

search for similar instruments and discussions with advisors'^, 

tv/o nev/ instruments, a paragx^aph construction task and a 

2 

sentence construction task , were used to measure learning of 
mathematic al stx'uc tur e . 

With the paragraph construction (PC) test, students 
v/rite a paragraph explaining the mathematical relationship(s) 



The author is grateful to Professor Lee J. Cronbach 
for his suggestions and criticisms in this area. 

2 

Results of a pilot study indicated the sentence con- 
struction task v;as too constrained a task for Ss. Sentences 
were often nonsensical or inappropriate, e.g. "Probability 
and event are both nouns." Ss who did respond appropriately 
to the sentence construction task usually responded in a 
similar but expanded manner on the paragraph construction task. 
Thus, in general, the useful information from the sentence 
task vras obtained also from the paragraph task. Therefore, 
it was decided not to use the sentence construction task in 
this study. 
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betweeji key ccnceptn. Although Robhkopr and Thurnor (1970) 
aGkecJ. Sr. to wri (:■(.) nboul: only ouo concept a I. a time, bho 
emphasis of the present study is on the relationship between 
concepts and thus it was felt that the instructions to explain 
tlie rolationr'hip l)0tween two concepts cori'o^iponded more closely 
to o^j.r definition of structure thaji did the method of Rothkopf 
and Thurner. 

Over view of the Study , The purpose of this study was 
to examine thr communication of the mathematical structure of 
a j?i'Ogrammed text in probability to Ss. Ss , chosen from three 
school levels (elementary school, junior high school, and 
high school), wei-e assigned randomly within each school level 
to experimental and control groups. Ss received instruction 
m their regular classrooms-^; experimental Ss read the prob- 
ability text, while control Ss read a programmed text on a 
different mathematical topic. Pri.or to and follov/ing instruc- 
tion, Ss received tests on achievement, attitude, and cognitive 
s.tructui'e. 

Cognitive structure was investigated using V/A and PC 
techniques. Digraphs, graphs, and task analysis were used to 
repi'osonb contf^nt structure. The various representations of 
content . structure and cognitive structure were compared. Ss 
learning cf mat];.er;;atical structure v;as compared to achievement, 
attitude, ar/1, in .^or.e ce.ies. abilicy data. 



^At the high school level, it v/as necessar;/ to remove 
some Ss from their I'egular classrooms. 



C1J.APTER II 



Review of tho Li borai;u:ro 



JMathomnticn ecliicatorn Iv-rvG pul an iricreardngly nl;rong 

ernpJioriis on cofnmiiriic<'.rl;in[^; the r-brucLui'O oj' [imthGinatic:^ to the 

learner, jjarticularly in tho public r;chooln (Hoport;, of the 

Commission on Matliomatics, 19139). Brov;n (1971) in discussing 

the changes in the mathematics curriculum over the past few 

years states: 

v;o siiudy ^lumbers thorriselves [and] reflect 
the n-j '."uro of rnathomatics as a dir.;f!ipline . 
holheinri\/icianr:' refer to i!: s:: ::: Lruc tur^e. V/r^ 
ai'O studying the basic structi.u^^e of matlie- 
jTiatics [ and in] piu:siiit of propoi'"^'ies that 
reveal the underlying: nature of tho mathe- 
matical discipline . . . 

Begle (in pi'oparation , Chapter III) claims 

A prerequj.site to a study of tho learning 
of mathejiiatios is a clear ujider standing of 
Lhe nature of the mathematics to bo learned. 
V/e consider mathematics to be a set of inter- 
related , abstract , symbolic systems . 

Begle goes on to say 

llius the .structure of mathematics has tv;o 
parts. On tiiC one hand, eoch mather.atical 
system has its ov,ti internal structure. On 
the other hand, there are linkages betv/een 
difJ'erent systems v;hich also contribute to 
the structu-t'e ol' mathematics. 

Sehv/ab (1962) argues that the structure of the cur- 
riculum should represent the structure of the discij^line and 
it ir this structuru that v/c are atteiiipLing to communicate to 
the student. Scott (1955) in studying the organization of 
text concluded that the academician does put structure in 
curriculum and that empirical factors represent this structure 
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rairl;y v;olj., Ilowcwoi^, JkHun ri.c?! (:i/)71) :i ti cl i.r.r.unrritiK [nc.fitnl 
asr.oclatlojir. .indicu (;or. tliat ciiiTornnt mrat]'u;rria l;ici a.tis rnay see 
particular a^vpect.^; of mathematical stj'ucture cliff ereiil:ly, 

Tho conr;r>nrnKs , then, ir; tlinU the: curi-icDlum .should 
atbompl; L;o coTumni i cate rvLructuro to the tr.tudont. Thir: i^jtruc- 
ture may vary fi.e]jej.idirjg on the particulai' cur:i:lculu:n and the 
.structure is r,;ubject to empirical iirvestigatioii . 

The present ntucly in an emx)irical investigation of 
the communication of a mathematical r--.truc turo usinp: rricthoclr' 
developed by educational pr?ychGlogi;n;?..' (cf. Leeoe, 1962; Gagno, 
1970; Eothkopf &■ Thurner, 1970; Shavel^^'on, 1970). Stuaies 
cojicerning the learning of structure have concentrated on one 
of three basic elements: concepts, competencies, or algo- 
rithms. Although the present study concentrates on concepts 
and their interrelationships, the literature search in mathe- 
matics education revealed the other tv/o alternative approaches 
to be the only empirical elTorts in studying mathematical 
structui'e. Therefore, this chapter briefly reviev:3 the 
alternative approaches followed by a reviev/ of the approach 
used in the present study. 

. Alternate Approaches to Investip:atinp; Structure 

Orp;anization of competencies . Gagne (1962 , 1965 1 1970) 
discusses the logical analysis of content structure or task 
analysis. The focus of Gagne ' s suggestions is on competencies 
rather than concepts. The task analysis proceeds by deciding 
on the final competency (s) expected of students after instruc- 
^ tion and then logically determining all subordinate competencies 
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that are noor::\r/avy Tor cari';y:Hifr; ou.1v the f'innl tanA\(r,). Gaprio 
(1962) stateG that the task of a learning program is to: (l) 
insure high recallability oT relevant learjiing sebs on TA/hic?.h 
achievement han been demonstrated; (2) making possible identi- 
fication of expected performance and of new stimuli, for each 
newly presented task; and (3) guidinp; thinking so as to suggest 
proper directions for hypotheses associating subordinate 
learning sets with each new one, Gagne and Paradise (1961) 
present a study which lends support to the theory that differ- 
ences in i^ate of completion of a learning program ai'e primarily 
dependent upon the number and kind of learning sets the learner 
brings to the situation, and only seconda3:'ily upon his standing 
with respect to certain basic abilities. 

Regnier and de Montmollin (1968) used graph theory to 
represent content structure as described by Gagne (1962, 1965). 
That is, points on the graph represent competencies. Thus a 
method for obtaining a graph from a logical hierarchy of com- 
petencies is given, but this graph is not directly comparable 
to a graph which maps the organization of concepts. Thurner 
and Johnson (1970) discuss the logical configuration of concepts 

Algorithmic approache s , A few researchers in mathe- 
matics education have been interested in the learning of 
mathematical structure. These authors have defined striictiire 
in D differf.-nt manner fi^om the present study but are noted as 
alternatives to the present procedures. 

Dienos and .'Jeeves (196^, 1970), Branca (1971), and 
Branca and Kilpatrick (1972) have developed one method for 
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.LJiveGlJ gatlrn;;: l()Di'nin[^; of inathonira t:ical tvb.ructuror;. Branca 
U-971) wac. concci'.nc^d v;ith Sr.;' L:r'a l-ef'le l; foi' leorrj:Ui}_^' gLpuc- 
turo. Sl; vjo.rc: n^;kod bo discover' the I'ulor. oT a ^mne b;y bi'ial 
and error. The Gtructuro oT the game wan the Klein group 
strucLuro. '.rho rorniltn a.re not; jxjrtinenl. to the ]present study, 
but B.ranca'r; irnpj.i c:l t do f :Ln;Lti on o.l.' st:ructu.f.'o ±s important. 
S wan said to have learned the structure when he had correctly 
dotorminod the rulers of the game and verbalized these rules 
in a rnan?ier consistent wii:h the v/ay the rulec; v/ould be 
expresi^ed in mathematics. Ihis notio]*i of structure departs 
J'roui cither S}iavel.';on ' {Vy/O) definition concerning relation- 
ships between concepts or Gagne's (1962) reference to logical 
structiu^e oJ' conipe tencie s . 

Scandara (1971) outlines his basic theory of scruc- 
tui'al learning developed through a series of empirical and 
theoretical studies. He "proposes and defends [.•.] that 
rules are the basic building blocks of all mathematical 
knov/ledge and that, if looked at the right v/ay, all mathematical 
behavior is rule govei-ned. [Scandura, 1971^ IS'^-] Scandura 
(1971 1 P* 186) uses "rule" in a different sense than Branca: 

a class of behavior is said to be [rule 
governed ] if the behavior can be generated by 
a cormnon alg;orithmic (generative) procedure 
of some sort... a person who has mastered ajiy 
miderlylng procedure should [. . .] be able to 
generate each and every response, given aiiy 
particular stimulus in the class of stim.uli. 

".While Scandura refers to linguistic theories, he appears to 

derive his "rules" subjectively rather than empirically. 

Secondly, tViough this set of rules may explain behavior it 

does not appear to be reducable to relationships between 
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concept, r. 5 pa.T'i:i.cu"la.rJ,y sirco Scarjdm'O emphnr/izes p3:*ocesf3 
ratlier than a ntatic entit;y of the type tho present Btudy is 
concoi'nod with i.n Lorrnn o.C Ghruotu:t'0. 

Mayvw? and Greeno (1970) hypothesized that different 
instructional procedureG might produce qualitatively different 
loarninft- outco.-r.r;r:. "The concept of binoiriinl probability war- 
taught ucing a method that emphasized calculating v/ith the 
formula, and a method that emphasii^ied the meanings of the 
variable c in the formula [Mayer & Greeno, 1972, p. 16J>] . " 
Results of three experiments indicated there was not a signi- 
ficant differonco between treatments in terms of the total 
transfer test score. However, the transfer test was divided 
into four parts: familiar items, transformed items, unanswer- 
able items, and general questions, "Large interactions in 
transfer performance were obtained in three cases, indicating 
that the two methods produced structur-ally different learning 
outcomes [p. 165]." This study indicates content structure 
may have an effect on performance tests as v;ell as cognitive 
structure measures. 

Concept Approach to the Learning of Structure 

The concept -api^roach to structure is presented in 
detail by other authors (cf. Gagne , 1962; beese, 1962, 1957; 
Anderson, 1969; I'lllenbaum & Rapoport , 1971; Shavelson, 1970). 
Therefore this review ^vi 11 briefly present only the main 
points. 

Cent en t s true t ure . The literature concerning content 
structure may be divided into two categories depending on 



15 

v;liether the einphasis is on the organization oT concepts or 
competencies. Structure emphasizing concepts is most rele- 
vant to this study, however, some attention is given above 
to organization of competencies as an alternate method since 
this is more common in mathematics education. 

Kopstein and Hanrieder (1955) carried out one of. the 
first studies v;hich suggested using directed graphs (or 
digraphs) (cf. Harary, et, al. , 1955) to represent content 
structure. Points on the digraph represented concepts and 
lines between points indicated relationships betvjeen concepts. 
Although the purpose of their study — to investigate the 
strength or \^ul]:ier ability (cf . Hax^ary, et. al. .. 1955) of the 
resultant digraph — is no 1: relevant to the' present stud;/, 
their suggestion oi traiisf orming content into a digraph is 
most important. 

Kingsley, Kopstein, and Seidel (1959, p. 5) discuss 

the use of graphs to represent content structure,: 

The requirement exists for a metalanguage • 
in v/hich to describe' communicable knovjledge. 
A strong candidate for this role is the mathe- 
matics of nets and graphs... It will be readily 
apparent that such a representation amounts to 
a 'map' of a knowledge space. 

Shavelson (1970) reviews the literature concerning 
the use of digraph;^ to represent content s^:ructia2?e . Addition- 
al!:; be gives the rules for titans forrr.ing er.ch sentence in the 
content: to a digraph (see Shavelson, 197^-^ ^^p]:^, ::di:: ^) e::d 
shows how to combine the separate digraphs into a super-digraph 
which represents the total content structure presented by a 
text. Shavelson' s m.ethods are used in the present stud;}^. 
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Ol^h^r fluclior. (cP. Jolirinon, lOf^L^ 'l/X-V, 1909; Fra^^^o, 
1969) unod cl:I{':i'ni.li8 ( o rnprenoiil; oonlont. r* true l.uz*e , but do not 
develop procrdu.rori .for iriarpinf; tho instructional material v/ith 
a dip;rnph an did Shavelnon. Frrtrn and Silbif-er (1970) and 
Frano (1970) dif:cu::r oxkrns'ionn of tho xico oS' d.igraphfi Lo 
iiiclixd-* ^^oqucricf^ of.' ]).ror.onlatia.n . Andn.rT.o]] (1969) prescntr; 
a theorotical d.i f.'cur.si on o.f hov/ thor;o proce dures mirjht be 
extended to include the sbructuro o.f teacher presentation. 
There oxtcn^nionc oi' the ugo of dif;^rap}jr: ar^* not u.':;ed in the 
pi'er-ent rt.ud;/. 

Cor:.ni i iva rlM'uc turo , iJoerc C19Cv?) oxplainr.^ that the" 
moaninpjf ulnesn of words refers to orf^anized .relatione among 
the words and ajnonp; the v/ords and objectc in the natural 
woild. AusuV.'il and Fitzgerald (1961) re .oi' to the structure 
ill inerr.ory a? an id^^aticnal ecaf roldinfj;. 'Tiiat is, a i>er3on 
stoi'os concei^t.r. iji memory in an or{2;anized majmer. Lippman 
(1971) discuss'-jr the development of this orp;ani2a tion in memory 
and studied the difference in organisation due to ago. LijDpman 
concluded that a shift in type of organization occurs near 
the age of seven. Bruner (I960, p. 7) has proposed that 
'^Grasping the structure of a subject ir. imderstanding it in 
a v/a;/ that permits many things to be relatod to it meaning- 
fully. To leai-n structure in short is to learn hov/ things 
ai'o r^^lated." Anderson (1969i .p» S) inciicatos 

[static] structuj'e is the production of 
multiple associations among units of infor- 
mation and the prese^atation of logical thinking 
statements which interrelate them. It includes 
orgajiized response patterns such as classifica- 
tions, concepts, and principles which approxiniate 
rigid (static) associations... 
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Pillenbaum and Kapoport (1971 5 P* 1) comiect this structure 
to lingiii Stic r; : 

Relational systems in linguistics are charac- 
terized by their elements and the types of 
relations holding among them. The s;yntactic 
system generates strings of minimal syntactic- 
ally f unctioninff, elements and specifies the 
structural interrelationships among them. 

Shavelson (197^, p. l) defines structure "as an assemblage of 

identifiable elements and the relatd.onships between those 

elements." We concur with Shavelson' s definition and approach 

the study of structure on the basis outlined above. 

Empirical stvidies using the word association technique . 
This section outlines prior studies v/hich have used WA tech- 
niques to assess cognitive structure, particularly those 
studies which use the WA test as a learning measiu?e. The word 
association technique was used to investigate cognitive struc- 
tui'e in the present study. Noble (1953) proi^osed this method 
as a measure of meaningfulness. Deese (1965) and Dixon and 
Horton (l968) reviewed the research on associations. Shavelson 
(1972) presents an argument for this measure's relationship 
to learning. 

Building on the i)roposal by Noble (1963)? several 
studies have \ised the V/A technique to examine learning. In 
a rioricE 01 r;;tudier:- by Johnnon (l^C;;, 19^v, 19^9) ? '^he number 
of v;ord associates v;as correlated with the niunber of problems 
solved in a study on the learning of a short unit on physics. 
He v/as not able- to show that responses on the association test 
were related miiformly to problem- solving success in the same 
v/ay either for all the v/ords on a single association test or 
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for the same word, on two association liOfjts, but he chowed 
certain i!!Vi)oi'ta.at jvilatioiiships* Johnscn (19&7) concluded 
thau wordG were more meaninaTul for hi^i^^ acliiovers than low 
achievers and also that meaningfulness is related to the fre- 
quency of occiirronco in text. Johnson (1969) claimed thab 
there was a si|';nirican 1": incivoaso in the numbors of responr::.cs 
to a V/A test after instruction as compared to before instruc- 
tion. Johnson also discussed the fact that concepts have a 
meaning both within and without a subject and thus the kind 
of structure in memory may not change so much as the quality 
of structui'e. 

Shavelson (1970) nsed the V/A technique to measure 
learning of physics structure. He found sipaiificant changes 
during instruction in instruction Ss ' responses to the WA test 
as well as significant differences between treatment groups 
after instnj.otion. 

Rothkopf and Thurner (1970) used the same insti'n.ict ional 
material as Johnson and Shavelson and found a high correlation 
between V/A respjonses and essay responses after instruction. 
Lambert (1970) claimed that both SES and ability are related 
to paired associate learning tasks. 

In siumr.ary, as argued by Shavelson (,1970), responses 
Lo tlio V/A hr:: L nol: or^ly reflocl. Mv; coniiLiv'-; st.ructui^o in 
memory, but also reflect leamijig. 

Comparisons of cop;nitive structure with content struc- 
ture . Shavelson (1970) appears to be the first author to 
compare an empirical representation of content structure to 
an emi)irical I'eTji'esontation of cog,?iitive structure. Shavelson 
O „ reviev/s studies leading to the components (cognitive structure 
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and content structure) and these studi'es are briefly noted 
above. Therororo, this section will discuss Shavelson's study 
only as it is the basis for the present study. 

Shavelson used physics material as instructional 
material — the same material which was used by Johnson (1965, 
1967, 1969) and Rothkopf and Thurner (1970). Ss (K = ^lO) 
were paid volunteer high school students (grades 10-12) v/ho 
had not taken a high school physics course. Ss were divided 
randomly into instruction (N = 28) and control (N = 12) 
groups. All Ss received aptitude, achievement, and WA tests 
as pretests- Instruction Ss read five sections of physics 
material — one section per day, each day being a tv/o hour* 
period — and responded to a WA test at the end of each instruc- 
tional period. Control Ss took only the V/A tests and did so 
in a smaller number of days. All Ss received an achievement 
posttest. 

Table 1 

Euclidean Distance Matrix: The Distance Between Content 
Structure and Cognitive Structure for Instruction and.:. 
Control Groups Across the Six Test Days 



DAY 

GROUP 


1 


c 


5 






6 ' 


IKSTRUCTIOf] 


6.^-19 


5.92 




4.90 


^•52 


4.22' 


GOr^TROL 


6.69 


6.28 


6.07 


6.17 


6.17 


6.25 



Shavelson ^s results indicated the instruction Ss did 
significantly better on the achievement posttest (p < .05) than 
control Ss and that instruction Ss performed significantly 
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higher (p < -O5) at post time than at pretest. That is, instruc- 
tional Ss learned, the iriaterial to a f.;igni.l'ican1; degree in terras 
of solving phyijics problems. 

The V/A tests v/ere administered in a repeated measures 
desigi'i and results indicated thai: control Sr?- maintained a 
stable cognitive structure throughout while instruction Ss 
shov/ed a variable cognitive structure presuinably due to 
instruction (see Table 1 from Shavelson, 1970, p. 85). 
Shavelson also noted that instruction Ss^ cognitive structures 
tended to move i;ov;ard the content structure as they received 
instruction. Instructional Ss ' cogni.tive structures did not 
change significantly in terms 01 configuration of concepts, 
but changed in a qualitative manner. Shavelson claimed this 
v/as due to the fact that ordinar;/ usage of the physics concepts 
had an influence on cognitive structure and, in fact, the 
physics instruction might actually reenforce certain associa- 
tions. In line v;ith these conclusions, Shavelson found an 
increase in WA I'esponse frequency by instructional Ss vjhich 
v;as not the case for control Ss. 

Shavelson was not able to shov/ a uniformly significant 
correlation between WA data and either aptitude or achievement 
data: 

To summarize, verbal ability plays a, decreas- 
ing role in association generation across 
instruction- days. But it is ar. ir.portant 
predictor of achievement. Abstract reasoning 
ability [...] plays an increasingly ir.portant 
role during le anting [...] and is an im.portant 
predictor of posttest achievement. This find- 
ing supports the interpretation that for Ss 
v/ho perform well in solving problems at the 
end of instruction (high posttest achievement), 
the concepts became more meaningful earlier. 

O 
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Subcoquoritly, these Ss were able to "chiink" 
in l'o:r'Tnobn or) i n the fonn o.C oqurjtionr;. Having 
Uheso equotions readily avyiiable in memory 
enabled them to solve jjhysics problems on the 
posttest on achievement more effectively, 
[Shavelson, 1970, p. 106] 



CHAPTER III 



Method 



Instructional Material 

The text used by the exporiiriental pii'oup v/an an intro- 
duction to pro'bahiliiy thooi:/ and was developed under the 
direction of the School Mathematics Sr;udy Group (SMSG).-'" The 
topic of probability was chosen because: (a) it could be 

presented by text alone; (b) it was Justifiable as important 
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mathematics for Ss to learn ; (c) it could be placed easily 
at most pointr:. in the regulai' curriculum r::oquence ; (d) it 
assumed a minimum number of mathematical concepts and skills 
and thus war^ approjjriate foi' a v/ide I'ange of grade levels-^; 
and, (e) it was unfamiliar to the majority of K-12 students 
in the Stanfoi-d University area. 



T]:e author v;ishes to express his appreciation for the 
help of Stanley Pogrov; and Eobert V/ise in v/riting the text. 
(The entire text is available from the ERIC Science, Mathematics 
and Environmental Educational Clearinghouse, Columbus, Ohio.) 

2 

For example, the School Mathematics Study Group argued 

Somie understanding of probability and 
statistics is essential for the educated 
ci^:izen in modern society. [...] Probability 
theory is a requisite for the techniques 
of statistical analysis and statistical 
inference that play so large a role in 
industry, government, economics, social 
science, and all branches of physical and 
Idological science [School Mathematics 
Study Group, 1971] . 

series of unpublished formative evaluation studies 
by the author and a study by McLeod (1971), have shown that 
grade five students are capable of learning the material, while 
at the same time high school students do not find the material 
to be at too low a level to keep their interest. 
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A pro/p\-unif)e("l. instruction I'OMiat — nmall steps, con- 
8l.;i*u.ctf.!(I .7.'0Jr;|')onr:or.; , nnd conti.ri.ual foedback on the correct 
responses — was used. The format was selected for several 
reasons. It jniiiiniiz.ed the number of substoriLive questions 
asked by students cirid thus minimized the chance that proctors 
v^ould ''teach" a structure different from the text structure by 
answering students' questions. And it permitted an examina- 
tion of the applicability of the structure methodology to 
students of various ages and ability levels. 

The px'otiaVjility text is divided into three sections 
of approximately seventy pages each. It assmnes the students 
have an intuitive idea of prediction, chance, and e>rperiment. 
Section 1 of the text covers the concepts of "probability," 
"equally likely," "outcome," "event," "experiment," and "zero. 
After coTi'pleting Sect;ion 1, the student should be able to list 
the ou^.comes of a simple experim^ent such as tossing a single 
die. Secondly, he should be able to determine which outcomes 
form an event, e.g. number greater than 5, and find the 
probability of this event. Section 2 adds the concept of 
"trial" and expands the concepts in Section 1 to more compli- 
cated experiments. Upon completion of Section 2, the student 
should be- able to distinguish betv/een a l^rial and an outcom.e; 
list the outcomes in an experj.ment such as spinning two spin- 
ners; determine v/hich outcom.es foi^m. an event, e.g. same color 
on both spinners.; and find the probability of this event. 
Section 3 covers, the concepts of "independent," ^'intersection, 
and "mutually exclusive" aiid expands previous concepts to 
e>cperiments such as flipping a coin three times. Upon 
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completion of Soctiori 5, the student should be ahle to: (a) 
determine whether two events are mutually exclusive or inde-' 
pendent; (b) find the probability of an event concerning an 
experiment such as spinning a spini:ier tv/ice ; and, (c) find 
probabilities of events involving dravdng marbles with or 
without replacement, V/ith the exception of a few frames 
toward the end of the text which require the multiplication 
of simple fractions, S should be able to rely entirely on his 
ability to count in obtaining correct responses to frames 
requiring numerical ansv/ers. 

A typical frame of the probability text is shovm in 
Figure 1. In general a frame consisted of a short -piece of 
prose followed by two questions. The student v/rote his answer 
to each question in the blank provided. At the top of the page 
iimnediately following the frame the correct answers to the 
questions were provided. A horizontal line was drawn across 
the page to separate the answers at the top from the new frame 
belov;. 

Figure 1. A tj^ical Frame from 
the Probability Text 

For the experiment 
of spinning this spimer, 
v;e say that Black and 
V^hite are not equally 
likely outcomes. 



1) Are the outcomes of the experimenb of tossing a 
coin equally likely? 

2) Are the outcomes of the experiment of throwing a 
die equally likely? 
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Ro-irre son 1; ai: :i. o i ; o.l.' Content Struct u;r e 

Content' structure was defined as the v/eb of facts 
(words, concejots) and their interrelal;ions in a bod.y of. in- 
structional material. In order to apply this definition . of 
content structure to the probability text, ten key concepts 
were selected for analysis: "probability," "equally likely," 
"outcome , " "event , " "experiment , " "zero , " "intersection , " 
"trial , " "independent , " and "mutually exclusive . " The key 
concepts v/ere selected a r^riori as being the most important, 
in a mathematical sense, in the text- That is, the text was 
designed specifically to teach these concepts and these concent 

r 

were thought to be crucial in tl:ie students' mastery of the 
instructional material. 

The key concepts appeared to vary in tv/o conceptual 
dimensions, as judged by thee author. Some stimulus concepts 
are more "concrete'' than others, i.e., they vary in the ease 
v;ith v/hich the?/ can be represented physically. For example, 
"zero" m,ay be considered more concrete than "indejjendent . " 
Secondly, the, concepts varied in their familiarity to students, 
i.e., students are likely to have encountered the concept of 
"zero" more often than the concept of "m_utually exclusive." 

Three alternative methods foi* representing content 
structure were used: digraph, graph, and task analysis. The 
lattoi' alternative is focused on relationship>s between cornpe- 
tencies rather than concepts, while the digraph and graph use 
concepts as elements. 

Digraph representation . One method for . repine senting 
structure in the instructional material, termed "content 



r-r'bructuro , " ir.; i-.h(:^ IJ-ieory of dire c bod {j;raphr; (ilarax-y, ot. al., 
1965). (Sc3e ShavGlson, 1970, Appendix A, or Sliavelson, 1971, 
foi' a summary of the theory of directed graphs.) The steps 
followed in a dif:-;;raph analysis are dor-;cx'ibod fully by Shavelson 
(1970, pp. 3S-^\0\ see also' Shavelson , 1972) and thus only a 
brief disciiGGion need be presented here. The probability con- 
cepts were reprosorrb ed by points on the digrajjh and relationship 
between concepts were represented by directed lines connecting 
points. As noted in Chapter II, the theory of directed graphs 
is an abstract mathematical theory of structure in which struc- 
ture is defined as points and directed lines. If the corres- 
pondence between digraph theory and the empirical v;orld is 
accujrate, then all true statements about the digraph are also 
true of the empirical world. The resultant digraph is 
considered to be one representation of the content structure. 

Follov/ing Sha.velson's (1970) procediires, all sentences 
in the .text whi.ch contained ■ .at least tv/o of the key concepts 
v;ere selected for the analysis. The reason for selecting this 
set of sentences is that v;e were interested in the way pairs 
of concepts are iiiteri^elated in the text, and the sentence 
is our ujiit of analysis. For example, the sentence "A proba- 
bility of 0 means i:hat the event has no chances of happening'' 
v/as selected hc^caiaoe the corcepts '^probability , " "0" (zero), 
Md "event" wore coiitained in the sentence. Each sentence 
containing tw^o or more key concepts v/as diagrammed using a 
parsing grammar (V/aio?iner and Griffith, 191:^7 )• l''or oui' 
example v/e obtained the lollov/ing diag:cam: 



event 



probabi-lity | means 



lias 



chancer 



o 



o 



o 



0 



The diagram v/as co7)verted to a digraiori uf^irjf-;: ShavelGon' 

For example, one rule is: 

a pre no sit ion is a v/o'rd used to shov/ the 
relabion of a noun or pronoiui to some other 
word in the sentence, k preposition speci- 
fies a relation betv/een tv/o points on a 
digraph and is represented b;/ a line. If 
the pi-eposition gives direction ("to"), the 
relation is asymetric; it the preposition 
doe s " not specify direction ( " of " ) , the 
relation is symmetric. 

A group of v/ords may act as a preposition: 
on account of , in spite of, divided by. 
[Shavelson, 1970, p. W-0] . 

The digraph resulting from our example is: 



rule: 



probability 



event 



;.ero 



chances 



From tlie iiidividual digraphs, a siiper-digx^arn v/as cor.structec 
incorporating the information from the single digraphs. 
Finally, a ^'distance'' matrix v;as created in which each entry 
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ropror.nnLod 1:iio rrd.iiimujn niunbox' of l:i.no{?3 coriE"ioc l:inc any pair 
oi' ke;/ concopbc. For om: examplo wo obtaiuod'''' : 



T) e c 





0 


1 


c. 


1 




00 


0 


1 




c 


CO 


00 


0 


CO 


z 


1 






0 



v/here: p = probability, 
G - event , 
c = chances , and 
z = zero 

Grarh I'eT/ro r-:onta ti on , The content r:t. rue tare or 
structure in the instructional material also v/as mapped v/ith 
g3?aph theory (llarai'y and Norman, 19^:^5)- Graph theory may be 
distinguished i'rom digraph theory in that the former ignores 
the direction oJ' lines while the labter places an emphasis on 
directed linos. The resultant graph was considered a second 
representation of content structure. The same key concepts 
'jere used in this analysis as v;ore used in the digi^aph analysis. 
A syiiimetric distance matrix is obtained from the graph analysis. 
The elements in the graph distance matrix are equal to the 
smallest eleme]-.Lt in each pair of corresponding cells in the 
digraph distance matrix. Only a slight modification of digraph 
i:)3.''ocedures is necossax^/ to construct the gi'aph. Thus, in the 
example presented in the digraph section above, the same 



In the actual analysis, the distance matrix is com- 
puted only for the super-digraph. However, this example 
demonstrates the connection between the digraph and the 
distance matrix. 
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.L'<:rjulLi.:. llowovcji'^ Lfiu grupli and d.i:rt;aiK;o inobj/ix arc chaii{^';(j(j. 
an Gbown below. 



1. Cir*:.i ill : 



ppobabi lit:/ 



>:,oro 



m « 



l)ir> t:anco Kati\i >: ; 





0 




Z 


0 


1 


2 


1 


1 


0 


1 


•-1 


2 


1 


0 


5 


1 


2 


J 


0 



Woto that the israph distance matrix will alv/a;ys be syirmietric 
while this ii:^ not necessarily true of the digraph distance 
matrix. Obviously, if a symmetrj.c digraph results from the 
digraph analysis, the structui*o representations by graph and 
digraph will be equivalent. 

Task analysis repre sen t at i on > Finally, task analysis 
v;as used to map the structure of the instructional material 
(Gagne, 1965, 1970). Task analysis produces an alternate (to 
the digrax>h /graph analyses) struct;uj.**al representation. Point 
represent cot(i[)otencies and lines represent relationships be- 
tween competencies. This is a psychological definition of 
structure and therefore different from v/hat subject-matter 
experts mean v/hen they use the term s truct'.U'c . However, v/e 
use task analysis in the present study to link the digraph/ 
graph representations to a more traditional approach. 
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A tuGk finalytiit; v/orks backwards J'rorn the J.'inal outcome 
or i:-!crtructioii , in a logical maimer doj^cribiny all the nece.s- 
nary proroquiru Lor: that tho atudont neocLs in order to exhibit 
a satiGfactory per.rorinance on the final outcoineCs), to the 
inibial- coin])0 t;oiicio;'- the ntudentr; ai'O asj;uinod to porif^ocs, Thir:: 
procodur(^ rr:r\\]\,r\ in a hierarchical flov/ chart v;hich maps the 
instructional noquenco (to some extent) and the psychological/ 
logical structure of the text, 

Foz' example, after completing Section 1 of the proba- 
bility text, tlio ;::tudent should be able to compizte the 
probability of tho event "nimber greater than 3'^ for the 
experiment oV tonr.ing a fair die. In order to do this he 
must be able to apj^ly and comprehend the algorithm for computing 
probabilities.. To do this he must be able to determine the 
number of outcomes in the event "number greater than 5/' 
determine v/hich outcomes are in the event, determine the number 
of possible outcomes, etc.. This portion of the task analysis 
is shov/n in Figure 2. 

Figure 2 
Samcle Task Analvsis 



< 



Solve problem by 
Applying; Alp:orithm 



Gomi)re hend 
Algorithm 

— ^ 



Write number 
of outcomes 
in event 



Compute PCevent ) 
using; a3.p;orithm 



Write number of 
possible outcome: 



List which out- 
come s form eve n t 



List all possible 
outcomes 
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Sub;1ects 

Students irojn an elementary school (Gi^ade 6), a junior 
high school (Grade 8), and a senior high school (Grades 9-12) 
served as subjects (Ss) in the study. Wo S had received prior 
formal instruction in probability. 

Since the experiment was conducted_.at . the end of the 
school year and over approximately a four v/eek period, several 
Ss were deleted altogether or from certain analyses due to 
absenteeism, withdrav/al from school, or conflicts with other 
school activities. In this section the number of subjects 
associated v/ith each school level reflects the nuniber of Ss 
who attended at least one test session. 

Grade six subjects . Grade six Ss (W = 59) v/ere taken 
from two intact classes in one elementary school in Santa 
Clara County, California. Ss were assigned at random to 
e>:perimental (H = 35) and control (I\f = 26) groups, Ss varied 
v/idely in ability, Lorge-^Thorndike IQ's ranged from 68 to 145. 
The school principal reported that Ss varied in socio-economic 
status (SES), ethnic background and motivation; and that 
several Ss v;ere performing well belov/ expectations. A few Ss 
had severe reading defi.ciencies. In general, most Ss in the 
sample may be described as low-middle to middle SES, near 
average in ability, and Caucasian. 

Grade eight subjects . Grade eight Ss (K = 87) v;ere 
taken from three intact classes in one Junior high school in 
the same district as the elementary school ^3S. os v/ere 
divided randomly into control (N = 44) and experimental (N = 45) 
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groups. The principal indicated that ther^o Ss were average 
and c;].iglrl;ly above average in matheinatical ability. .Mo severe 
reading difricultios were noticed "by the exporiTrientor . Only 
a .few Ss showed low motivation; this impreL:>sion was confirmed 
by the mathemabicr:-: teacher. The only abiliLy data made avail- 
able to the cxpoi^iinonter v/ere scores on the Minimum Essentials 
of Modern Mathematics test and these scores ranged from 11% 
to 99-5% correct. 

Viifr)-i r: cl 1 0 0 1 sub ;i e c t s . The third group of Ss (K = 3^0 
v/ere volunteei-s recruited from study halls and mathematics 
classes; ±n one li:if';h school in San Mateo Coun by , California. 
Ss were ninth (N = 13), tenth (N = 5), eleventh (Tl = 10), and 
twelfth (N = 8) graders. Ss v;ere divided randoml:/ into 
experimental (N = 20) and control (N = 1 'l ) groups. The 
principal described the Ss as middle and upper-middle SES, 
Caucasian v/ith varied mathematical ability and background. 
Ability data were not available for these Ss. 

All Ss had completed a ninth grade mathematics course, 
many had completed some algebra and geometry, and one S had 
completed a trigiiometry course. Many Ss were not taking a 
mathejnatics crourse at the time of the e>;;[)eriment . The remain- 
ing OS were ejirolled in a variety of mathemBtics courses. 

Treatments 

The e>rperimental treatment consisted of instruction 
from the programmed text on probability,- theory. Subjects in 
the control group read a programmed text on a mathematical 
topic unrelated to probability. At each grade level, the 
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control groui;)'r:; to: I; v/ac similar in lorinat -md outward apxrear- 

ance to the probability text. Tlie texts used for control Ss 

had no iriathorn?jticr.; iw comirion with the ;probability text. 

Ss in the sixth and eighth grade control groups read - 

a programmed text on .factors and prime numbers.-^ It was 

divided into live ejections and covered tlie bardc concepts of 

composite and prime numbers. The text develojjed a division 

algorithm for testing vdiether a number was prime. Multiples 

of a number and least comimon multiples of pairs of numbers 

were covered. Each section v/as followed by a criterion test. 

Sub.j'.cts in the high school control group read a pro- 

6 

grammed text on negative number bases. It reviewed positive 
number bases and computation in positive bases other than 
base ten. The text v;as divided into three sections: (a) 
polynomial representations of numbers, (b) negative number 
bases including addition and subtraction of nmnbers in negative 
bases, and (c) representation of negative numbers in negative 
number bases. 

Instrumentation 

Attitude questionnaire . The attitude questionnaire 
was the 'Tro-Math Composite" scale (pyoil; see V/ilson, Cahen, 
and Begle , 1968) developed by the National Longitudinal Study 

^Tho factors and prime niunbors text v;as developed for 
SMSG by J. W. Green. (Available from the ERIC Science, Mathe- 
matics , and Environmental Education Clearinghouse, Columbus, 
Ohio.) ' . 

The negative number bases text v;as developed for SriSG 
by Norman Webb. (Available from the ERIC Science, Mathematics, 
and Environmental Clearinghouse, Columbus, Ohio.) 



or Mathemotical AbilitioG (NLSMA). The p.cnlo was dcGi^'ned to 
moeiGure genc?ral attitude toward mathoinaticG. An example item 
is 

I oen Rot along perfectly well in everyday 
life without mathematics: 

(A) strongly agree, (B) agree, (C) don't Imow, 
(D) disagree, and (E) strongly disagree. 

Internal conFjistency coefficients alpha for Uiis scale were 

• 69, .72, and .76 for the sixth grade, eighth grade, and high 

school subjects lised in this study. 

Acliie voment i;e r-jt s . The main achiovement tor:t v/as 
designed to test compreh^^nsion and ajjplication of the concepts 
in the instructional material. The achievement test v/as. con- 
structed from a large pool of items. Item data from prior 
instrument development studies were analyzed to arrive at the 
final version of the achieveirient test. It consisted of tv/enty- 
eight free respoiise and seven multiple choice items (Appendix 
A). The first thirty items tested comprehension of the material 
presented in the probability text. For example, one item 
testing comprehension of the concepts of "probability,*' 
"event," and "outcome" is: 

If you toss three coins, P (at least one 
tail) = _. 

The last five items required the student to use his compre- 
hension of probability in a different format. For exs-mple , 
an item, testing comprehension of the concepts of "event," 
"mutually exclusive," and "outcome" is: 
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Eacli 0.1' the 16 dots repronents 
a posruibln outcome oJ' an exjpoi'i- 
inojit. Anrumc the outcoinoG are 
equa].l;y .1/ Rely, 

A pair of events that is mutually oxclusive is 

(A) A,B (B) B,C (C) A,C (D) A, A 
(E) None of these. 

Internal conF?if.^tency coefficients alpha calculated from exjjeri- 

mental subjects data in the present study are reported in 

Table 2. 

Table 2 

Internal Consistency Coefficients Alpha 
by Test Occasion^*' 



Test Session 

Posttest Retention Test 

.902 .387 
.852 .827 
.780 . ,79^ 

^* calculated from e>rperimental Ss data 

In addition to the thirty-five item achievement test, 
tv/o ten item tests v;ere given to the experimental subjects at 
the end of Sections 1 and 2 of the probability text, respec- 
tively (Appendix A). These tests only v/ere used to give 
eyT^erimental Ss b ^^vo^Tes^ check and to hel^:- insure that Ss 
did not proceed so quickly through the programmed material 
that little or no learning took place. 




Six til Grade 
Subject ^. , . , 
Group ^^S^^^^^ '^^^^^^ 

High School 
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VJoi-<l \'i;:.i;oc:i rjtloii bof.t , Tho purpose of the v/orcl asso- 
ciation (V/A) tekyt v/as to assess Ss* learning oi' mathematical 
structure. Ss received the following instructions for the V/A 
test . 



IWSTRUCTIOWS 

This is a test to see hov/ many v/ords you can think of 
and v/rite dovni in one minute . 

You v/ill be given a key word about probabilit";^^ and you 
are to v/rite dov^n all the words v/hich the key word makes 
you think of. 

Write down as many words as you can. You will probably 
not be able to fill in all of the spaces on a page, but 
do the best you can. Be sure to think of the key v/ord 
after each v/ord you v/rite dov/n, because the test is to 
see hov/ many other v/ords the key v/ord makes ;>ou think of. 

For example, suppose I asked a mathematician to v/rite 
dov/n as many words about mathem.atics as he could think 
of v/hen given the word "set". He might put dovm the 
following 

SET 



' Set C > >la/i 't^ Set LLmni^ 

Set A .^L./ Set 

You v/ill notice that as a mathematician he did not use 
"jjut" or ''ready" since they are not v/ords about mLathe- 
matics. 

In this same v/ay , you should try to think of v/ords about 
I>robability and mathematics that go with the key v/ord. 

You v/ill have one minute on each page. I will tell you 
when to go to the next page . 

Do you have any questions about what you are supposed 
to. do? 

The WA test consisted of one page of instructions and one page 
for each set of responses to each of the ten key concepts, 
respectively. On each response page, a key concept was printed 
at the top-center with the remainder of the page consisting 
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of tvjo columiio o.f the key concept reT.)eatocl. with a blank to 
the right of the word. Four random sequences of the stimulus 
words (Appendix A) v/ere used to prevent a possible sequence 
effect. A pai'ticular sequence was assigned randomly to S at 
each test a 6m i n i s t r a t i o n . 



Parap;ra]Dh construction test ■ An alternate measure of 
the learning of structure was the paragraph construction (PC) 
test. Each PC test consisted of one page of instructions 
(reprinted below) and five pages for students' resr^onses. 



IWSTEUCTIONS 

This is a test* to see how well you can explain hov; two 
v/ords from probability are related . You v;ill be given 
two v;ords fx'om probability. You are to write a para- 
graph vfhich explains how the two v/ords £0 together in 
probability. Write the paragraph as if you were e>rplain- 
ing to a friend how^ the tv;o v;ords are related . 

You may write as much as you ne—d to e>rplain how^ the two 
words are related in probabil'.ty . 

You will be given five pairs of v;ords and you - should 
explain how each pair is related. Each word-pair - 
vjill be printed at the top of a page. You v^ill have 
tliree minutes for each pair of words. ■ I wall tell you 
v;hen to go to the -next page. 

For example^ a student wrote about how V/ATER and STEAM 
are related. He explained the relation betv/een V/ATER 
and STEAM as follows: 

V/ATER STEAM 

Vlaber is a liquid made up of hydrogen and oxygen. V/hen 

v/ater is heated to its boiling point, it turns to a gas 

called steam. If steam is cooled, it turns back into 

water. Both water and steam are made of the same ele- 
ment s'i hydT'ogen and oxygen. 

Are there ai^j questions? 



You may turn the page and begin. 
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Each responne page had a concept pair printed in . the upj^er 
left-hai:3d corner-. The rest of the page was leTt blank for S 
to write a pcii'ngi'aph explaining the mathematical relationship 
betvjeen the two concepts listed at the top. 

The niunher of Ss used in the study was not sufficiently 
large to allow l;he use of all possible pairs of V/A 

stimulus v;ords since an excessive amount of testing time v/ould 
be required. Since random sampling of pairs of v;ords would 
not guarantee a representation of the variety of distances 
(determined by the digraph analysis) between concepts, pairs 
of concepts were chosen with the constraint that the set of 
pairs reflected the variation in distances betv;een concepts. 
(This is a matrix sampling problem. See Lord and Novick, 
1968, pp. 255-258.) Using the fiu'ther constraints that S 
would be presented only five pairs of concepts and that the 
PC test v;ould contain all ten stimulus v/ords from the V/A test, 
tv/o versions of the PC test (see Table 5) were derived. 

Table 5 

The l\vo Versions of the Paragraph 
Construction Test 



PC Tost 1 


PC Test 2 


experiment — zero 


zero — e qu a 1 ly 1 i k e ly 


equally likely — mutually 
exclusive 


trial — independent 


outcome — independent 


outcome — mutually exclusive 


probability — event 


probability — e:'Cperiment 


trial — intersection 


event — .intersection 
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Four- i'o.ndom order i:3 (see Apixuidiy A) oJ." the coiicept 
pairs were used on each PC test, A particular order of con- ■ 
cept pairs was assigned randomly to S as well as assigning 
either PC T-st A or PC Test B at random to S::.;. 

Proceduj;es . 

The study was conducted duj?ing regular school hours 
near the end of the - 1971-1972 school 7/ear. Its duration 
varied I'rom 21 to 29 calendar days. Orientation/pretesting/ 
■instruction/. . ^/instruction/posttesting were carried out 
during consecutive class meetings. Several class days elapsed 
between the posttest and retention test sessions. Experi- 
mental Sb were never separated from control Ss during the 
experiment. 

At least one- proctor was available at each session to 
manage materials and procedures. Proctors did not instruct 
Ss, but ansv/ered procedural questions, read test instructions, 
etc. The regular teacher was present to maintain discipline. 

The first class meeting in each subject group was 
devoted to orientation and pretesting. Pxdor to pretesting, 
Ss were told the experimenter was interested in finding out 
how students learn matheinatics. 

The attitude questionnaire, the ViA test, and the 
achievement test on probability were administered, in the 
order listed, to all Ss prior to instruction. The attitude 
questionnaire was given first so that tests and treatments 
used in the expe.i'iment would not affect Ss ' responses* The 
WA test was administei^ed prior to the achievement test to 



insure tlial: tho acliievemGnt best did not acquaint Ss with 
possible responses to the V/A test. It v/as felt that neither 
the attitude questionnaire nor the V/A test would influence Ss ' 
respoiises to the achievement test. A brief discussion of. the 
purposes of the study (in lay terms) and hov/ .to use i^rograinined 
instruction effectively followed the pretesting. 

Each S then i^ead the text assigned to him. At' the end 
of each text section, S received, a short reviev; test over the 
section he had Just completed. (The probability text did not 
have a test for Section 5, the final section.) Since instruc- 
tion was self-paced not all Ss needed the entire instructional 
period to complete their reading of the text; conversely, not 
all Ss read the entire text. However, all Ss completed the 
second text section and most of the third section. Ss who 
finished early v^ere allowed to read, drav/,. or study material 
of their choosing so long as the material was non-mathematical 

After instruction, all Ss were given the VIA test, PC 
test, and achievement test, in the order listed. The VA test 
was given first so that the other instruments did not affect 
Ss' responses. It v/as reasoned that responj::es to the achieve- 
ment test would be least affected by having Ss respond to the 
other instruments and thus it v;as given last. 

Several days later the V/A test land achievement test 
v/ere readministered to Ss, in the 5.;equence listed. Tlie, 
purj>ose of this test admiiiistration was to measure the subject 
retention of the material. 

Sixth and eighth grade Ss participated in their 
regular mathematics classes. High school Ss participated 
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during their ro(;ulap study hall or mathematics period. In 
the latter car;o, wore removod .rrom their ro[j;ular clarjsroom 

Class periods were fii'ty, seventy-- ii ve , and IM L'ty- 
three'^ minutes duration for sixth grade, eighth p;rade , and 
high school Ss respectively. The duration of testing and 
insti'uction wei'e eleven, seven, and eight class meetings for 
grade six, eight, and high school subjects, respectively. 
The eighth grade classes met eyery other school day, all 
other classes met every school day. In some instances other 
school activities would cause a class not to meet on a par- 
ticular school day, V/ith the exception of one eighth grade 
class, all testing and instruction took place before noon. 

Table 4 indicates the class meetings in which each 
subject grour; participated in the experiment, the days on 



Table 4 

Calendar Days on which Procedures were carried out 





School 
Level 


Pretest 
Orient a tion 


Instructioji 


Po5ttest 


Retention 




Sixth 
Grade 


1 


10,11 


11,12 


29 


Eighth 
Grade 


1 


7, 7 Q 


11^*^ 




High 
School 


1 




10,11 


21,22^*- * 



^Due to a conriicting school activity, one class of 

Ss was posttested on day 15» 

Due to school scheduling, half the Ss were retention- 
tested on day 21 vjhile the remainder were tested on day 



^Due to other school activities, four j^eriods were 
forty-two minutes in length. 
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wliioh clar.;:.5 Tnnp-f,:i.nf;;:5 wore huld, arul w?if}thor Lho mooting con- 
{.-listed of tenbi/ig or in/f;truc'l;ioji. Tlie cUiy-niual.)c:rc. rcpj^osent 
calonclar dayr, . 

Dor.'.:i.r;ri 

^ l''ollov;inp: ox':ic^ntai.i on and pi'etnstlnp, Ss in throe 
difforent schooJ. Ic-'vol::^ v/orci d.ivid^.d at iTjnflorn into n:q:ei'i- 
mental and conl;:i^ol groups. The oxpcriinon lal group I'eceivod 
instruction in probability while the control group received 
inritruction on an unr-elabod mathoinatical topic. Arter instru 
tion, all received a x^o^^-t bo?:;!; and a retojil-ion tost. ThuG, 
in. fionoral, a treatment; by grade by test occasion design was 
ornployed v/itJi r^yi)eated measures on the last factor. The test 
used in the study and tlie tost occasion are given In Table 5- 

Table ^ 

Tests Administered and Test Occasions 





Pretest 


Posttest 


Retention Test 




Attitude 
V/ord Associabion 
Achievement 


V/ord Association 
Paragraph Construction 
Achievetnont 


V/ord Association 
Achievement 



To sujmaariy.e the design, achievement and word asso- 
ciation testing was a repeated measure pre-post-retention 
design. The paragraph constixiction test was a x>ost-only 
desip:,*n. The attitude questionnaire was administered only at 
pretest. 



Result a 

Tluir: clirifii.or coirtoinr: Uio annlyson of the data J'roin 

the siucly. V/liile t>he aaalynec aro explained below aiid the 

I'csultc or eacl) aiialycis aro givoji, the interpretat j on or 
the results ir; foiuid in Chapter V. 

C on t e n t St I'U c t u j' o 

Dini'aph analysis . Content structure vjas mapped with 
the. met:hod or di[■^l'a]:h fmalynis. The resulting digrax-^h distatice 
mati'ix io pror.onted in Table 6. The greater Lhe value oT Bxi 
element in the di.':;tance matrix, the greater the dissimilarity 
betv/eon l;he t\;o concept^:. 

Table 6 

Digraph Distance Mati'ix for Probability 
Text Structure 
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The values in the digraph distaiiCe inatrix represent 
dissimilarities between concepts. The valuerj in the related- 
ness coefficient matrix, a representation oJ' cognitive structure, 
represent similai'ities betv;een pairs of concepts. In order 
to compare these i;v;o types of matrices, the digraph distance 
matrix v/as converted into a similarity mati-ix (see Table 7)- 
Shavelson (1970) jxerformod this modification by interchanging 
the largest element and the smallest element, the next largest 
element and the next smallest element, etc. and then dividing 
each element in the distance matrix bj the largest element in 
the matrix, iiovjever^ this method results in a divisioji per- 
formed solely on jbhe basis of a particular matrix. A more 
general technique, namely dividing one by the element plus one, 
is preferred. (Thus the element 2 v/ould be replaced by 1/(2+1) 
or .555? the element 1 would be replaced by .5^ etc.) This 
method has the advantage of making comjjarisons betv;een studies 
possible. Also, should an element be infinite, Shavelson 's 
procedure would result in an entire matrix of zeros. The more 
general method results in seros only for the infinite elements. 
Mote that the digraph similarity matrix V7ill cojitain only 
nujTibers between zero and one, inclusive, and thus ''resemble" 
the relatedneps coefficient matrix. 



Dig.rapli iiiinj lar.i.t,y Kial.i'iy Tor Probability 
Text Structure 
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measure clustering and discusses theoretical issues concerning 
clustering. It nppet32.'G his approach might be useful for deter- 
mining pi'e-o>:.i.r;ting structure in memory, but it depends on 
having S learn v/ord .lists to obtain a baseline and thus is 
not applicable to the present study. Thomas Johnson (1969) 
gives definitions and reviews literature concerning cognitive 
structure and the use of proximity measures. Of special 
interest is his discussion concerning a unique metric solution 
arrived at from data which is essentially non-metric. 



,K V u L"i k a 1 L 9 6^- i ) di r. c u r: o c) c m u 1 1 i. d ni o n r : i on a ]. c a 1 j. n p a n d 
givoj.; a [■ bi'oiip/M' Jtial:hc[natical ioundaLlon ro\: Shej^ai'd'o tocdi- 
nique* Since multidimensional r.caling asr^umes a dimensionality 
to the structuj-'e and this is consistent with o^xc understanding 
oj; mathoma hic;^; it wa::, .selected lor the predion I: .study. This 
technique requires no metric assumptions and yields a best- 
fitting geometric representation in a space of the smallest 
number of dimensions. Kruskal (p. 5) gives the following 
guidolJ.nes in detormirig liov; v-/ell the data fit :n a given space: 



ioti'css Goodiiess of Fib 

. POO j^oor 

. 100 fair 

.050 , good 

.02:^ excellent 

.000 poi'fect 



The interrelations among concepts in the digraph 
similarity matrix were examined v/ith fa:'uskal's (196^^0 multi- 
dimensional scaling procedure. For the purposes of this study, 
it was decided to accept the smallest nuniber of dimensions 
that would allov/ a "g;ood" fit to the data. Figure 3 presents 
the graphica]. representatioj) of the results. Appendix B con- 
tains the numerical results of the analysis. 

Graph a.jia 1,7 sis . Graph analysis also v/as used to 
examine content structure pr-csented b.y tlie probability text. 
As noted in Chapter III, the essential difference betv/eer. graph 
analysis and digraph analysis is that graph analysis does not 
use directed lines. That is, the graph analysis results in a 
syimnetric distance matrix (see Table 8). 
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Figure 3 

Plot or MultidiinenGional Scaling Solution 
Content Digraph Analysis 
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Key for Plots 



P = Probability 
I = liidependent 
E = Event 
Z = Zero 

L = Equally Likely 



S = Intersection 

T = Trial 

X = Experiment 
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0 = Outcome 
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Table 8 

Graph lJit:\tanco Matrix for* Probability 
Text Structure 

> 







• 

P-i 


Ind. 


(!) 
W 


o 

IH 

(1) 

IS] 


• 


t 

•P 


■ 

u 
(■■-( 


■ 

Pi 


• 

• 


Out . ■ 


Probabili ty 




0 




]. 


1 


2 


.1 


2 


1 


2 


2 


Independent 




o 
t_ 


0 


1 


5 




2 


c:: 


2 




2 


Event 




1 


1 


0 


2 


2 


1 


1 


2 


1 


1 


Zero 




1 


5 




0 






3 


2 


2 


3 


Equally Likely 




2 


5 


2 


3 


(J 






2 


3 


1 


Interc.ection 




]. 


2 


1 


2 




0 


2 


2 




1 


Trial 




2 


2 


1 


5 


2 




0 


1 


2 


1 


Experiment 




1 








2 


2 


1 


0 


3 


1 


Mutually Exclus 


ivo 


2 


2 


1 


o 


3 


2 


2 


3 


0 


2 


Outcome 




2 


O 


1 




1 


1 


1 


1 


2 


0 


Again it ifi hel 


p.f;ui 


to 


convert 


the 


graph 


distance matrix 


int 


a similarity ma 


trix 


using the 


same 


procedui'e 


as 


was 


used 


for 



the digraph distance matrix (See Table 9)« I<ruskal's (196^^) 
multidimensional scaling was performed on- the graph similarity 
mati'ix and tho plot of the results are , chovm in Figxire ^. 
Appendix B contains the numerical results of the multidimensional 
scaling procedure. 

Task analysi:.^ ^ Using procedui'es suggested by Gagne 
(1962, 1963^ 1970), a task analysis was pei'formed on the 
probability text to examine the heirarchy of completeness 
represented in the subject matter. The resultant heirarchy 
is presented in Figure The investigatbr was not able to 

determine a satisfactory method foi' obtaining a "distance" 
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Table 9 

Graph Similarity Matrix for Probability 
Text Striicture 
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Figure ^1- 

Plot of Multidimensional Scaling Solution 
Con Lent Grapli Anal;/ r; Lr; 



n 



L 



T,0 



Key Tor Plots 



P = Probability 
1 = Independent 
E = Event 
Z = Zero 

L = Equally Likely 



S = Intersection 

T = Trial 

X = Ex-periment 

li = Mutually Exclusix^e 

0 = Outcome 



ERIC 



^1 

q oj 

p Q) c[i B 

bo 0) o 

•H -P ctj -p 
-P 0 »H d 

CO pq Jh o 
»H ^ 
P 




4.) 



0 



CI) 
C\1 



v-l O 
-P 

(0 
•r-l 

'•d 

V-i 
H 



Tar;k Ana ly sin oT 
Probabilihy TGxt=^' 



o t1 'H o o 

<D -P CO 

Pi U O 7: 03 

o p< o r< p, 

O r^J O P 0 











^ - ^-^ 'A 




CD i^-i 0 










d 


PrH • 








S ' 0 OJ • 











o a) a; o -h 

^ rH s -P o 
CD PrH O 
^1 e ?H - 

O cOiH 

















CD -p 


•H S 




-P »H 






0 CD 






IH ^ -p 0 




H 















q (D 


(D 


0 0 


to 






-P CO 

























I 

o o 

o ^ 
o 

a) a) 

-P CD 

03 U 



o 
-el 



•H 

(/^ O ^ 
rH rH 

CD -P 

o 

1} O rH 
CT3 -H 

-p 

o 

-P -H 05 

'H ^ 
CD 0 

3 

0 Ph 

0 



o 
o 



I qO 

o q 

o 

o > 

Jh 

O 0 'H 
is -P 

0 

0/'-N to 
-P CN 

cr^ fo 

CH rH -P 
O w-H 

0 CO <H 

CO - o 

0 

0 fcO o 
CO -H 
O CO 



b2 



ERIC 



CD 



O -1-1 








O 






J, J) 


tl) 




•H Pi 
















o 1-1 








A 




CD 
N 
•H 

O 

a 

CD 



\ tTl o 

<U . P r-l O 

rl W -H O 

- ; L,; 'L' tj; 
O 

05 Ph O 

1] li 











o 








r-l C) 




u 




•H 




'r-l O 






















a; 




rH 






CO 


•H 


CI) 




£^ 




O 


• HO 


O 




■P 


rH 


O 


rH 

















(iJ 


O JO 


r-Cl 


r-l 


o 


1) CT3 


u 


,H 'H 


Pi 




d EH 


O 


EH 


o 








1 












5 




u 




hO 




05 


■H 


o 




o 






53 









o 








cu ^; 


0) o 


c; o 




•H 'H 




^ -P 




O O 


ft a) 


a ci5 


CD ^ 


o d 


IP r^H 












o 




V6 



CD 0 
£1 

O P-^ 
O 

o 




(V 
•P 



(1) 



;5 (;} cj u) 











0 








.a 






p 


4^ 








CD 






S 4-^ 


.CI 










o 






en 




a; 


0 




Ph U 


•P 






Ci) o 


-H 




> 




Wr 






In 



4-^ OJ 

0 o g; q 4-^ 
^ Fi 3 a 

0 O 'r-\ ^ 0 
fH fcD !h O > 

^ 0i 0 r^-i 

h CO p., ^v---' 

o /J ctj Ph 
o o w 





bp B 






0 (i,^ 












o o 








P4 

















ERIC 




inatri>: from Ihc ro.':julta.ni; heirarchy . One could count "boxes" 
betv/een concej)l:s, bui-; the boxes do not represent concepts 
alone but ratlicr they represent inanipulations or perrorinances 
with concepts. Thus, for exaiaple , the concept "outcome'' and 
"event" appear in ::;everal boxes and one could arrive at 
several distances betvjeen these conceptr; depending on the boxes 
selected. Additionally, the boxes are derived in a somewhat 
subjective majxner* A logical analysis by one author may not 
be the same as a logical analysis for a second author; thus 
causing the two authors to arrive at different distance 
matrices. The task analysis should be useful in interpreting 
the other content- analyses and the analyses of the V/A data, 
but does not appear to be a satisfactory representation of 
structure as v/e have defined it. 

Achievement, Abili.t;/ , and Attitude Data 

Sixth grade subjects . Lorge-Thorndike (L/T) verbal, 
non-verbal, and total scores as well as the Calif ornia. Test 
of Basic Skills (CTBS) reading and arithmetic scores v/ere 
available for the sixth grade Ss. Descriptive statistics for 
these data are given in Table 10. Table 10 also contains de- 
scriptive statistics for the "Attitude Toward Mathematics" 
and jjretest, posttest, and retention test achievement data. 

Achievement data were analyzed by a 2 x 5 (treatment 
by test occasion) analysis of variance with repeated measures 
on the second factor. Results indicated the treatment effect 
was significant (F = 22.62, df = lAO, p< .01) v;ith experi-- 
mental Ss scoaring higher than control Ss (see .Table 10). The 
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tost occar^lon effect was signiflcairt = 18.9Ip, df = 2/39, 

p < .01); and tho interaction effect ( l;roatmo.nt x tost occasion) 

was significant (F = 14,16, df = 2/59, P < -01). 

Since thero v/as a loss of several [';rade six subjects 
at retention ^;est, a second anal:/sis was porforined. This v;as 
a 2 x 2 (treatment hy test occar^ion) anal?/ sir. of vai'iance v/ith 
repeated measures on the second factor (test occasions v/ere 
pretest and posttest). The results obtained v/ere : a) a 
significant Lreatiiient effect (F = 2^^;,69, df = 1/51, P< -01); 
b) a sip^nificarrt: test occasion effect (F = ^0.1^^ df = l/3'l, 
p< .01); ajid c) a significant interaction betv;een treatment 
and test occasion, effects (F = J^i.Jl, df = 1/51, p < .01). 

Eip;ht]) {Trade subjects . Scores on the Minimum Essen-' 
tials of Modern Mathematics (IlET'll) test were available for 
eighth grade Ss. Table 11 describes these data as well as 
the attitude and achievement data. 

Achievement data were analyzed by a 2 x 5 (treatment 
by test occasion) analysis of variance with repeated measures 
on the second factor. Results obtained were: a) a significaiit 
treatment effect (F = 114.92, df = 1/76, p< .01), e:<perimental 
Ss scored hip;hcr than control Ss (see Tabic 11); b) a signi- 
ficant test occasion effect (F = 86.85, df = 2/75, p< .01); 
and c) a sirjiif icanl: interaction betv/een effects (F = 65.55, 
dJ- = 2/75, P< .01). 

Hip;h school subnects . No ability data v/ere available 
for high school Ss. Descriptive statistics concerning the 
data obtained from the attitude and achievement tests are 
presented in Table 12. 
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Tab .1.0 .1.1 

DoriCr.i pbivc Sbabic.tic::; .for Elglith (Irado 
Subjocbs Ability, Attitudo^ and 
Achievement Data 
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Table 12 

J)ci;c'.r':i.jit;ivo Sbn lirj l.lcis for llifli School 
Subiicctn Attitude and Achievement, Data 



ATTITUDE ' ACHIEVEMENT 



TO MATH PRETEST POSTTEST RETEh'TlON 

Sample Size 20 19 15 -1 

Mean 52.500 4.526 21.000 24-. 656 

Standard 

^* Deviation 6.157 5-502 5-014 5-259 

Kaz lAJ-v VA 28 55 

Range 

Min 21 C 12 IS 

Sample Size 14 14 11 6 

Mean 51-714 5-500 6.4 55 7-855 
Con Standard 

* Deviation 7-559 4.852 5-95^ 5-656 

Max 41 19 14 17 

Range 

Min 17 0 12 



A 2 X 5 (treatment by test occasion) analysis of 
variance v/ith repeated measures on the second factor was used 
to analyze the achievement data. A significcuit treatment 
effect (F = 22.55, df = 1/14, p< .01), a f-'nif icant test 
occaEion effect (F = 25•19^ df = 2/15, p<-01), and a signi- ' 
ficant ir.teractio:: betv.'een effects (E = 24. [;9, d"? = 2/15, 
p < .01) v;ere found. 
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Since there was a Iobs of f^evoral .^iiboects at reten- 
tion toGt tlnio, a 2 x 2 (treatment b;y I;cgI: occasion) analyoin 
of variance v/ith repealed measures on the second factor also 
was used to analyze the achievement data (pretest and posttest 
data only). RcBults v/cre a significant treatment effect (F = 
25. 6[}, df = 1/2^1-, p < .01), a signif icani; test occasion effect 
(F = 90.05, df = 1/2^4, p < .01), and a significant in-^.eraction 
term (F = 72-52, df = 1/2^+, p <.0l). 

Comparisons amonp; school levels . To investigate the 
effect of -school level, a 2 x 5 x 2 (treatment by school level 
by test occaGion) analysis of variance with repeated measures 
on the third factor was performed. The retention test data 
were not included in this analysis due to loss of Ss in the 
sixth grade and high school levels at retention test. Of 
interest here was a significant school level effect (F = 28.08, 
df = 2/152, p <.0l), a significant treatment effect (F = liy.J'^-, 
df = 1/152, p < .01), a significant test occasion effect (F = 
86.81, df = 1/152, p< .01), and a non-significant interaction 
between treatment and school level effects (F = 2.06, df = 
2/152). 

Cog?:ni ti ve S t;i'uc f'xr e 

Cognitive structure was investigated v/ith word asso- 
ciation ''WA) and pai^agraph construction (PC) techniques. 
Results v/ere analyzed in a 2 x 3 x 3 - (treatment group by 
school level by test occasion) design. Each set of WA data 
yields a s;>Tm]ietric relatedness coefficient (EC) matrix repre- 
senting the relationship betv/een pairs of key concepts in 
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inc:;mor,y. S.inco lho>,\o matrices are , jL';ijiiilar;ii"..y matrices they rnay 
bo compared to tiio similarity matrices obtained in the analyse 
of content structu.re. The structure ropror.iorjted by each HG 
mati'ix was examined by Kruskal's (1954) multidimenGional 
scaling procedure. 

Analy:.-:is ol' VJA renponr:;o.s . Marr.hfill and Gofer (1963) 
review ten indices which conve.rt V/A data to a numerical index 
indicating the degree of relatedness between concepts. Many 
of these indices are not applicable to the present study since 
they handle only two concepts or else deal v;it?.i WA techniques 
that allow only one response to each stimulus concept. 

The method selected in this study to convert WA data 
into a matrix of similarities between concepts is the related- 
ness coefficient proposed by Garskof and Houston (1963). The 
relatedness coefficient (RC) depejids on the number of response 
to a given stimulus v;ord and the overlap between response dis- 
tributions for pairs of stimulus wo.rds. The formula for 
obtaining the RC coefficient isi 

RC = A ' £ 

(A-B) - [n^ - (n-lfl^ 

where 

^ A and B represent the r^mk order of words 
under A which are shared in common with B 
and the 3?ank order of words in E v/hich are 
shared in A. 

° X' • B represents the rank ordex' of words in A 
multiplied by the rank order of words in B . 

^ n represents all of the words in B (the 
longer list ) . 

o P 

represents some fixed number greater than 
zero which may be determined from the shape 
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of Lhe x^robal.dlity distribution of the 
rorrponrien, P \!or\ 30 1 equal to 1 in 
tliii.: r.tud;/; all portions of the S'r^ 
recponc^e distribution received equal 
weight* 

The RC coefficient may have a ceiling effect as sug- 
gested by SJiaveJ.rion (1970). Additionally the BC coefficient 
is Bymmetric and thus would not be able to reproduce a dif^raph 
distance matrix (asyuietric) exactly, Garskof and Houston 
(1965) examine the validity of the HC coefficient. 

Each relatedness coefficient may rajige from zero to 
one inclusive and indicates the degree to v/hich tv/o concepts 
are related to memory. The larger the value of the 
relatedness coefficient the closer the relationship betv;een 
the tv/o concepts. For example, an eighth grade S responded 
to event and experiment on the post V/A test as follov/s: 



Event 

Event 
Number 
Trial 
Outcome 



Rani-: 

5 
2 



Exi3erimont 

Experiment 
Event ■ 
Outcome 
Trial 

Probability 



Rank 
5 

5 

2 
1 



Thus BC 



(5-3 2). 




= .593 



(5 ^4 3 



2 1) 



3 
2 
1 



- [^^-(3-1)^]^ 



i'or each S a 10 >: 10 ftC ma'.ri;-: v/ac rormed ueing the 
relatedness coefficients obtained from that S's WA responses. 
Fov each cell of l:he 2 x 3 >^ 5 design (treatment group by 
school level by test occasion) a mean EC matrix and median EC 
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matrix (calculated elemenb by element) ^ero lormed. Shavelson 
(1970) uBGd only a median RO matrix. The underlying normality 
(or ].ack of it) oJ* relatednoGo coef I'iciontG may be argued, 
but the author prefers to present both the' mean and median RC 
matrices. The RC matrices obtained from the WA data may be 
found in Appendix C, Each RC matrix was scaled using Kruskal's 
(195^0 procedure; the results may be found in Fig-ures 6-50. 
Wlien most off-diagonal elements were aero for a particular 
RC matriv:., e.g. pretest V/A data, no scaling rjolution is given 
as the procedure is not applicable to such a matrix- Appendix 
B contains the numerical results of the scaling solutions. 
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Plot of Multidimensional Scaling Solution 
Sixth Grade E:cperiment al Subjects Protest 
Mean Relatedness Coefficient Matrix 
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*'*'Key for Fig-ores 6-35- 

P = Probability 
I = Independent 
E = Event 
Z = Zero 

L = Equally Likely 



X 
EZ 



T 



PM 



0 



S = Intersection 

T = Trial 

X = Experiment 

M = Mutually Exclusive 

0 = Outcome 



% #indicates more than one concept located at a particular 
point. 
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Figure 7 



Plot oC iiuHjidimeriGional Scaling'; Sbliil-.ion 
Sixth Grade Experimental Subjects Post best 
Mean fielate'dness Coefficient Matrix 
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Plot of Multidimensional Scaling Solution 
Sixth Grade Experimental Subjectc Porvttest 
Median Kelatedness Coefficient Matrix 
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Plot o.f Multidimensional Scaling Solution 
Sixth Grade Experimental Subjects Retention 
Mean Relatedness Coefficient Matrix 
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Plot of Multidimensional Scaling Solution 
•Sixth Grade Experimental Subjects Retention 
Test Median Relatedness Coefficient Matrix 
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Plol; oT Multidimensional Scallnp; Solution 
Sixth Grade Control Subjects PrctGr.-l; Nean 
■ Holatedness Coefficient Matrix 
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Plot of Multidimensional Scaling Solution 
Sixth Grade Control Subjects Posttest Mean 
Relatedness Coefficient Matrix 
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PiRTjire 15 

Plol; o.r Mijllri.d.imenaional ScalinK Solution 
Sixth Grade Control Sub,-jectc; Eotonlion Test 
Moan Rolatedness Coefriciont Matrix 
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Plot of Hulti dimensional Scnlinf.^, Go lu Lion 
Eic'liUi Grade Experimental Subjoctr; Protest 
Mcoji Relate cine as CoefficiGnb Matrix 
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Plot or r'lultid.i:Tien£'.ional Scaling Solution 
Eighth Grado E2q:)GrimenT;al Subjects Po.'tteBt 
'Ncodian Relatedness Coofficient Matrix 
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P.loi: o.r Multidinienyional ScaliiiK Solution 
Eigh1,.l.i Grade L'xp^^i'iiiiental Subjoctn Jtetontion 
Mean Relntedness Coe.rficie.nt Matrix 
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Ei{-?;ht.li Grade Experiinorital Svb.jectG fiobontion 
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Plot of MultidiTnensioaal Scaling Solution 
Eighth Gi\ade Control Subjects Pretei't 
Mean Kelatedneas Coefficient Matrix 
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KiBTiro .19 (cont.) 
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Plot o.f." MulLidiinoiiGional Scaling RoluUion 
E:i.n;}ith Grade Control Subjcctn Por.l.tost 
Mean Itelatedness Coerficient Matrix 
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Plot of ilultidiniensioiial Scaling Solution 
Eiglrbh Grade Control Subjects Retention 
Mean Relate'.lness Coefficient Matrix 
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J.''iG;ui'(^ 22 

PJ.ut of MijJ.ticlinie.nriioJial Scalinrj r.loli;l;io.Ti 
llif';h Gc?iool Eyj)eriino.ntol Siibjoct.". Prohost 
"Moan HnlatednoGG Coori'iciont riatrix 
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I'M r','n:ro 25 (cont . ) 
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Hif!;h School Experimental Subjecbn l^ebontion 
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Figure 27 

Plot of Multidimensional Scaling Soltition 
High School Control Subjects Pre- 
test Mean Relatedness Coefficient Matrix 
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Plob o.C mLitidimenKional Scaling Solution 
lli{?:]i School Control Subject rj Poott.jst 
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Plot, or Multidimonnional Scali.ni'; Solution. 
High Sclioo]. Control Sub-jectr; Hatonbion 
Mean Relatedness CoeiriciGnt Mal;rix 
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. Ana r.v iris of PC rospon,e)es * Tlie paragraph coriGtruction 
(PC) tGclinique v/ar; used as an alt:ex'na't;e meariiui'e to. examine Ss' 
cognitive structares. Each paragraph was examined with a 
digraph analysis, aiialagous to the analysis of content struc- 
ture. (Trivial responses such as ^'event is outcome's cousin'^ 
v;ere '■'leleted.) Eacii S v;as anked to v/rite one paragraph con- 
cerning each of five pairs of concepts. Eive digraphs, 
corresponding to the five paragraphs, vjere combined to forin 
a super-dipjraph (one fo:r each S). Then, ^for each cell of 
the 2 X 1 (broabment hy school level by test occasion) 
desig]!, an element by element median v/as calculated and these 
median elements y/ere combined to form a PC distance matrix. 
(It should be noted that each median entry v;as obtained from 
a different W, depjending on the number of Ss v;ho gave a 
response corz-^e spending to that particular entry.) Although 
each S v/as required to discuss the relatioiiships betv/een 
only five pairs of concepts, at least' some Ss in each experi- 
mental group found it necessary to include other relationships 
and thus no infinite elem.ents v;ere found in the PC distance 
matrices, i'inally, the PC matrices v;ere converted to a 
similarity matrix in the same manner as for the digraph (see 
Tables 15-17)- Scaling solutions i'or each PC sim.ilarity 
matrix are presented in P'igui''es 51-35 ond the numerical 
results of Kruskal^s (196'^') procedure are foimd in Ap^pendix 
B, (The sixth grade control group PC m.atrix is not given 
due to the fact that ■'•o usuable responses v;ere obtained.) 
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Pa:r'ap;:i.'np]) Constructloji Siini'La:rit:y r-lfjti'i'x J.'or 
Six.tli G:rade Exi)erimen-hal Ss 
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^decimals omitted 



Table 1^1 

Paragraph Corjstruction Similarity Matrix for 
Ei gh t h Gr a de E>rp e r i me 11 1 a 1 S s 
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Table 15 

Paragraph ConstTU.cl;ion Siiiiilorit:/ Matri>: £or 
Eighth Grade Control Sb 
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* decimals omitted 



Table 16 

Paragraph Construction Similarity Eatrix for 
High School Exi^erimeiital Sg 
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3533 2000 5000 



1.0 2000 2000 2500 2857 5555 



2500 2000 3333 2000 2000 1.0 2000 2857 2500 2500 

3555 5000 2857 2500 2000 2000 1.0 5000 2000 5553 

5000 5555 3555 5555 2500 2857 5000 1.0 3555 5000 

2857 5535 5535 2500 2857 2500 2000 2500 1.0 5000 

3353 5000 3535 ^000 3555 5555 5555 5000 ^^000 1.0 
* decimals omitted 
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Tr. 3555 2500 2500 2500 2500 2857 1.0 , 5000 2000 5555 

5000 2500 2857 ^i-000 1667 5555 5000 1.0 2000 5000 

1250 1111 0 1250 5555 5555 2000 1667 1-0 5555 

2857 2357 2500 5000 2000 5000 5555 5000 5555 1.0 
* dec ima Is omitted 
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Plot or Multidimensional Scaling Sol 
ParaGraph ConBtruction Data 
Eilghth Grade Control Subjects 
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l*'ip;ure y-\- 

Plot; oJ' Mulbidimonyionul Scalirifj Bol.ution 
PaiTi ])h Con r., in-'U c t i on B n 1; ti 
lliRh School Exper:Lm(3ntal Subjects 
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Figure 55 

Plot o.r Multidimensional Scalinc; Solution 
PornRPraph ConBtruction Dnl;a 
llitih School Control Subject rj 
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Figure 55 (cont.) 
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Conmarison oi' V/A, Achievoriie;t].l- ^ Ability, and Attitude Lata 

A corrolational analyc-iis oI the data obtainc-id from 
each experimental g-^-'o^^P was perrormed to investigate the 
rela1;ionnhi]>G cunong various t^yjcs of data gathered on Sc. 
Due to t]ie quite different types of data gathered, two inter- 
correlation rnabricoG v/ere obtained. Tables 18-25 present . 
product-rriornent intercorrelation matrices and non-par anie trie 
(Keiidall Tan rsnk correlation) intercorrelation matrices. 
The reason for obtaining tv/o types of correlations is that 
one can reasonal}l;y expect IQ an.d achievement, for example, to 
come. from a bivariate normal distribution and thus the 
product-moment correlation is appropriate. On the other hsind, 
there is no prior evidence to indicate that the Euclideaii 
scores (from the WA data) are normally distributed and one 
might v;ish to use the more conservative Kendall correlation. 
PC data v/as not analysed by subjects v/ith an Euclidean distajice 
score and thus is not included in the correlation analyses. 
Euclidean distance scores, explained in the next section, are 
a measure of how well Ss^ cognitive structures corresponded 
to the content structure. Perfect correspondence between 
achievement data and WA data would be indicated by a correla- 
tion of -1.0 rjince a smaller Euclidean distance score implies 
a closer relr?/uionship betv/een content structure and cognitive 
structure . 
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Table 18 



P;r.'od.ii.ct riomcnl; CoJ.'i-Glatioii i-. 
Sixth Gi'ade Exjjerimental Group 



Att. 

Nath 

Pre 
Ach 

Post 
Ach 

Ret 
Ach 

Pre 
Gra 

Pre 
Dig 

Post 
Gra 



Att. 


Pre 


Post 


Math . 


Ach. 


Ach. 


1 . 000 


126 


195 


(52) 


(51) 


(50) 




1.000 


Z|.3Z|.* 




(51) 


(50) 






1.000 






(51) 



Ret 
Ach. 

oey-i- 

(25) 

2^-9 
(22) 

721* 
(22) 

l.OOC 

(25) 



Pre 
Graph 

-025 
(52) 

156 
(51) 

-081 

(50) 

050 
(25) 

1 . 000 

(52) 



Pre 
Digr . 

-02-^1- 
(52) 

160 
(51) 

-077 
(50) 

051 
(25) 

1.000* 
(52) 

1.000 

(52) 



Post 
Graph 

-078 

(50) 

-55^+ 
(30) 

_/.|42* ■ 
(51) 

-0^+1 
(22) 

Z(.qz(. * 

(50) 

^-1-88* 
(50) 

1.000 

(51) 





Post . 


Ret. 


Ret. 


L/T 


L/T 


L/T 


GTBS 


CTBS 




Digr. 


Graph 


Digr. 


Verb. 


N.V. 


Total 


Read. 


Arith. 


Att. 

Math 


-071 

(50) 


-546* 
(22) 


-547* 
(22) 


-209 
(50) 


-195 
(50) 


-215 

(50) 


-159 

(5,0) 


-621 

(50) 


Pre 
Ach 


-5'4-5 
(50) 


-257 
(21) 


-26o 
(21) 


275 
(29) 


311 

(29) 


508 
, (29) 


206 
(29) 


555 
(29) 


Post 
Ach 


-460* 
■ (51) 


-457* 
(21) 


-472* 
(21) 


684* 
(28) 


596* 
(28) 


674* 
(28) 


665* 
(28) 


7^1.7* 
(28) 


Ret 

Ach - 


-061 

(22) . 


-253 
' (22) 


-246 
(22) 


675'* 
(22) 


esQ* 

(22) 


722* 
(22) 


627* 
(22) 


722* 
(22) 


Pre 
Gra 


465* 
(50) 


569 
(22) 


525 
(22) 


-077 

(50) 


-206 
(50) 


-150 

(50) 


-020 

(50) 


-099 
(50) 


Pre 
Dig 


457* 
(50) 


564 
(22) 


520 
(22) 


-072- 
(50) 


-205 

(50), 


-148 

(50) 


025 
(50) 


-093 

(50) 


Post 
Gra 


998* 
(51) 


656* 
(21) 


655* 
(21) . 


-255 
(28) 


-249 
(28) 


-261 
(28) 


-250 
(28) 


-259 
(28) 
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Tablo 18 (coirl;.) 





Posb 


Rot. Rob. 
Clrapli Dipjr. 


L/T 
Verb. 


N. V. 


L/T 
Total 


GTJ3S 
Read. 


CTBS 
Arith. 


Post 
Digr 


1.000 

(■31) 


65a* 658* 
(21) (21) 


-261 
(28) 


-2^-1-5 
(28) 


-263 
(28) 


-263 
(28) 


~2'\8 

(28) 


Ret 
Gra 




1.000 99a* 

(22) (22) 


00^1- 
(21) 


-0^1-2 
(21) 


-017 
(21) 


-056 
(21) 


-08? 

(21) 


Ret 
Digr 




1.000 

(22) 


002 
(21) 


-030 
(21) 


-Oil 
(21) 


-0^-'7 
(21) 


-094 

(21) 


L/T 

Verb 






1.000 

(50) 


801* 
(30) 


9^-5* 
(30) 


399* 
(50) 


772* 
(50) 


L/T 
N.V. 








1 . 000 

(30) 


953=^ 
(30) 


728* 
(50) 


705* 
(50) 


L/T 
Tot 




/ ■ 
r ' 






1.000 

(30) 


855* 
(50) 


776* 
(50) 


CTBS 
Read 












1.000 

(50) 


776* 
(50) 



Arith.. *^30; 



(H's in parenthesis) 
**deciinals omitted 
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Dig- 
Post 
Gra 



Table -19** 

Pank Oi'dei' Gorx'oln l;i onrj 
Sixth Grade Experimental Gi'oup 





Att. 


Pre 


Post 


Het. 


Pro 


Pre 


Tlx-. A" 




riath . 










Li P*r • 


Graph 


Att. 


1.0 




088 


-02 


105 


11^1- 


Pi /t1 
— U^)l 


Math 
















Pre 




1.0 




1^+1 


025 


027 


-I50 


A 

Ach 
















Post 






1.0 




' -222 


-214 


-5O6* 


Ach 
















Ret 








1.0 


-094 


-089 




Ach 
















Pi-e 










1.0 


992^^ 


5^1-0* 


Gra 
















Pre 












1.0 


53^* 



1.0 



Att 
Math 

Pi'e 
Ach 

Post 
Ach 

Ret 
Ach 

Pi-e 
Gra 

Pre 
Dig 

Post 
Gra 



Post Ret. Ret. L/T L/T L/T CTBS GTBS 

Digr. Graph Digr, Verb. W.V. Total Read. Arith, 

-024 -417* -^06* -162 -115 -154 -094 -012 

-115 -125 -125 188 225 227 201 246 

-314* -155 -132 421* 379* ^28* 459* 503* 

-058 -145 -142 598* 503*' 537* ^^1* 583 

')^8* 202 201 -215 -396* -328* -117 -202 

552* 184 183 -215 -395* -327* -116 "201 

984* 5y.|.5* 550* -196 -231 -250 -250' -222 
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Table 19 (cont.) 





Post 


Itet. Rot. 


L/T 


L/T 


L/T 


O'J'BS 


OTBS 




Dig.!' . 


Gi-aph Digr. 


Verb . 


N.V. 


Total 


Rg ad . 


Aritn» 


Post 


1.0 


554* 561* 


-197 


-251. 


-250 


-250 


-222 


Digr 
















Ret 




1.0 1.004* 


-034 


-067 


-088 


-019 


075 


















Ret 




1.0 


-05^-i- 


-057 


-08/ 




\J ( c. 


T)n fTr> 
















L/T 






1.0 


570 


^■6i 


mi* 
/II 




V t^l7Q 
















L/T 








1.0 


85^1-* 


515* 


555* 


EV 
















L/T 










1.0 


649* 


622* 


Total 
















CTBS 












1.0 


650* 



Read 

CTBS 
Arith. 



**decimals omitted 

I 



'J.'al):i.c 20** 

Produci; Momonb Corrolationrj 
Eiglrbh Grade Experimental Group 

Pre 
1)1 [';;r. 

-275 

(43) 

-0? 

059 
(41) 

-050 
(45) 

999* 
(45) 

Pre 1 . 000 

Dig . (45) 

Post 
Gra 

Poat 
Dig 





Att. 
Mat)). 


Pr(^ 
Ach. 


Post 
Ac h. 


Ret. 
Ach. 


Pre 

G.T'Mph 


Att . 

Math 


1 . 000 

(43) 


552* 
(43) 


2''!-0 
(41) 


2''i0 
(45) 


-2G8 


Pi'G 

Ach 




1 . 000 

(43) 


350* 
(41) 


5 14-* 
(45) 


_07/j. 
(43) 


Post 
Ach 






1.000 

. (41) 


891'- 
(41) 


0^i-9 
(41) 


Ret 
Ach 








1.000 

(45) 


-042 
(45) 


Pre 
Gra 










1.000 

(43) 





109 


Post 


Post 


Gi'aph 




167 


177 


(42) 


(42) 




- 1 OR 


(42) 


(42) 




vy _y -i. 


(40) 


(40) 


-12^ 


-112 


(42) 


(^1^2) 


C^i — L 




(42) 


(42) 






(42) 


(^^2) 


1.000 




(42) 


(42) 




1 . uuu 




(42) 





Eet. 

Graph 


Ret. 

Digr 


MEDM 






Ret. 

Graph 


Ret. 
Digr. 


MEMM 


Att. 

J^lath 


071 
(^1-2) 


067 
(42) 


203 
(27) 


Post 
Dig 




591* 
(41) 


574* 
(41) 


278 
(27) 


Pre 
Ach 


-137 

(42) 


-131 


2A-8 
(27) 


Eet. 

Gra 




1.000 

(42) 


997* 
(42) 


159 

(27) 


Post , 
Ach 


215 
(40) 


2y-\- 
(/■i-o) 


-052 

. (26) , 


Eet. 

Dig 






1.000 

(^^2) 


176 

(27) 


Eet 
Ach 


185 ■ 
(42) 


191 

(42) 


-025 
(27) 










1.000 

(27) 


Pre 
Gra 


316* 
(42) 


(42) 


328 
(27) 


(.IV s 


in 


Parenthesis ) 




Pre 
Dig 

Post 
Gra 


316* 
(42) 

(41) 


341* 
(42) 

581* 
(41) 


555 
(27) 

268 
(27) 


*p .05 

**decimals omitted 
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Att. 

Math 

Pre 
Ach 

Post 
Ach 

Ret 
Ach 

Pre 
Gra 

Pee 
Dig 

Post 
Gra 

Post 
Dig 



Talkie 21 



Rcuik Order GorrelatiojiG 
Eighth Grade Experimental Group 



Att. 

Math. 

1.000 



Pre 
Ach . 

245^ 



Post 
Ach. 

186 



Ret. 
Ach. 

158 



1.000 236^ 285> 



1.000 724=*' 



Pre Pi'e 
Graph Digr. 

-185 -isi 



■195 -198 



0^5 



051 



1.000 



971" 



Post Post 

Graph Digr. 

114 116 

-154 -132 

01$ 024 . 



1.000 -029 -036 -075 -080 



063 068: 



1.000 092 097 



1.00.0 971 = 



1.000 



Ret. Ret. MEMM 
Graph Digr. 



Att. 

Math 

Pre 
Ach 

Post 
Ach 

Ret 
Ach 

Pre 
Gra , 

Pre 
Dig 

Post 
Gra 



06^1- 
-147 
129 
037- 
339* 
364* 
406* 



C^-t;2 

-144 

10^!- 
027 , 
355* 
375* 
386* 



084 

136 

075 

053 
244 

263 

239 



Ret. 

Graph 

397* 



Post 
Dig 

Ret, 
Gra 

Ret 
Dig 

FiEMM 



*p < .05 

**deciinals omitted 



Ret. 
Digr. 

:.572* 
969* 



• 245 

153 ; 

175; .1 

i.oob- 
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Table rd'* 



Pd.^ocIucI; Moment Corrolalionn 
[lilOA School Experitiiantal Groujt 





Att. 
Math. 


Pre 
Ach . 


POfit 

Ach. 


Ret. 
Ach. 


Pj^e 

Graph 


Pl^g 
Dirrr. 


Post 
Graph 


Post 


Att 
Math 


1 . 000 

(20) 


090 
(19) 


2^;1 
(1!30 


-090 
(11) 


059^ 
(20) 


0G5 
(20) 


519 
(17) 


502 
(17) 


Ach 




1.000 

(19) 


0f';3 
(1?) 


103 
(10) 


(19) 


(19) 


151 
(17) 


l?iG 
(17) 


Post 
Ach 






1.000 

(15) 


9^11* 
(10) 


-099 
(15) 


-lO'l 

(15) 


-524 
(15) 


-524 
(15) 


Ret 
Ach 








1.000 

(11) 


-071 
(11) 


-085 
(11) 


-104 
(10) 


-102 
(10) 


Pre 
Gra 










1.000 
(20) 


098^ 
(20) 


519, 
(17) 


545, 
(17) 


Pre 
Dig 












1.000 

(20) 


5/U1 
(17) 


570^ 
(17) 


Post 
Gra 














1.000 

(17) 


995^ 
(17) 



Post 1*09^ 



Dig 



(17) 





Ret. 

Graph 


Ret. 
Digr. 


Att 
.Math 


-005 
(11) 


002 
(11) 


Pre 
Ach 


510 
(10) 


514 
(10) 


Post 
Ach 


-015 
(10) 


-057 

(10) 


Ret 
Ach 


-168 
(11) 


-180 

(11) 


Pre 
Gra 


618* 
(11) 


625* 
(11) 


Pre 
Big- 


656* 
(11) 


640* 
(11) 


Post 
Gra 


725* 
(10) 


742* 
(10) 





Ret. 

Graph 


Ret. 
Digr. 


Post 
Dig 


756* 
(10) 


754* 
(10) 


Ket 
Gra 


1.000 

(11) 


99s* 
(11) 


Rot 
DiK 




1.000 

(11) 



(K's in parenthesis) 

*P < .05 

**deciinals omitted 
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TnblR 23'* 

Kcuik 0.t.'dc3' Corral.'iliioJi.'j 
Ili^li School iSxporimGntal Group 





Alvt. 
Mnbh. 


Ach . 


Post 
Ach. 


Rot. 
Ach. 


Pro 
Grnph 


Pre 


PORt 

GrQ]jh 


Abb 


1.000 




21/| 




-0?6 




212 


Ach 




1.000 


031 


071 


093 


080 


169 


Por,t 
Acli 






1.000 


907' 


050 


010 


-226 


Ret 
Ach 








1.000 


019 


058 


-025 












1.000 


989* 


-050 



Pofjt 

205; 

162 



Fi-G ■ 1.000 -015 CO7 

Dig 

Post . 1.000 952* 

Gra 

Pont 1.000 
Me 



Att 
Math 

Fre 
Ach 

Pont 
Ach 

Ret 
Ach 

Ptc 
Gra 

Pre 
Dig 

Post 
Gra 



Rot. Ret. 

Graph Difjr 

056 



068 



275 



275 



511' 



-U 'JC 



572 



046 



0 



550 



353 



Post 

Die 

Ret 
Gra 

Bet 
Die 



Ret- 

Grapli 

511* 
1.000 



Ret. 
Digr. 

917* 
1.000 



*p< .05 

**deciinals omitted 
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Compar j.f>onn oJ* Coiihojil:; Gtructuro nm\ Cofi:n:i. ti.vo St;ruc1;ur'o 

0]io way to coinpare contenb r.ti'ucb\.ii'c a.ncl. cognitive 
* 

fjtructure id to oxarnino thc^ corroGpondGnco , or lack of it, 
between the multidimensional scaling solutions for the difjraph 
similarit:/ matrix (or ^J/nph similarity matr'ix) and the median 
(or mean) RG matrix. This method allows one to look only at 
group data. 

A second method of comparing content structiire with 
cognitive structat-e is the Euclidean distance. The Euclideaji 
distance is obtained by squarijig each dilTeroiice betv/een cor- 
responding elements of tv/o matrices (e.g. a S*s RC matrix and " 
the cligraph similarity matrix), sununing the squares, talving the 
square root of this sum, and dividing by iiinety (the number of 
o/T-diagOiial elements in each matrix). For each S^s BC matrix 
(at each testing time), the Euclidean disi:ances betv/een that 
RC matrix rond the content graph and digraph similarity matrices, 
respectively, v;ere calculated. These Euclidean distances 
indicate hov/ v/ell a RC matrix matches one of the content struc- 
ture matrices.*^ The smaller the distance, the closer the RC 
matrix comes to matching the content ^matrix. Descriptive 
statistics Tor the Euclidean distances at each testing time 
are given in Table 24. 



Since tlie irmiallest value o.f a RC in :3ero, some RC 
matrices consist only of off-diagonal elements that are zero. 
This may cause a Euclidean distance to be . smaller than it 
should be, since it is possible to be further av/ay from the 
content structure (e.g., some Euclidean distances between 
certain PC matrices and the content matrix are larger than 
the distance betv/een a "zero" RC matrix and the content 
matrix). 
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A nonparametric analycis of variance (Bradley, 1968) 
was perfo:rmed on the Euclidean distance data at each school 
level. Since Ihoi'o was a loss of su])oects at I'ebontion test 
in the sixth grade and high school samples, retention test data 
was not included in this analysis. Results showed a significant 
treatment effect (p < .05 £it the sixth grade level; p < .01 
at the eighth grade and high school levels) at all three 
levels. 

For each cell of the 2 x 5 >^ 5 (ti^eatment by school 
level by test occasion) design, a Euclidean distance between 
each mean and rnediem RC matrix and the digraph and graph 
similarity matrices v/as calculated. Table 2^ presents the 
results of these calculations. The Euclidean distance between 
each PC matrix and the content similarity matrices also is 
presented in this table. 
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Dincurision , Futui^e Woa:'k, tirid Summary 

A bi'lcf suimarry and discuGsion of the results of the 
study are pi'ef";o:inted in this chapter. Q.^ho reader is rerainded 
that results of all analyses are presented in Chapter IV and 
tluis the rstatistj.cal tables v/ill not he repeated liere. 

Discussion of Results 

Con t en t s t' rue t ur e . Content structux^e was mapped with 
the methods of digraph analysis, graph analysis, £md task 
analysis. Concepts deemed as being; most crucial, in a mathe- 
matical sense 5 for imderstanding the material were: "probabil- 
ity,'^ "independent," "event," "zero," "equally likely," 
"intersect j.on , " "trial," "experiment," "mutual],y exclusive," 
and "outcome". These ten concepts wei-e used as the key concepts 
in the digraph and graph analyses. 

The largest element in the digraph distance matrix 
(see Table 5) is 4, and this distance occurs only tv;ice. The 
largest element in the graph matrix (see Table 8) is 5- Thus 
the digraph and graph are "strong" (Harary, et. al. , 196^) 
indicating a tight formal structure in the subject matter, as 
.v/ould be e:}cpected. Interrelations among concepts in the two 
distance matrices were examined with Kruskal's (196^) mu'lti- 
dimensional scaling procedui'e. for the pui'^poses of this study, 
it v/as decided to accept the smallest number of dimensions 
that would allow a "good" fit to the data (see Chapter IV for 
a discussion of the fit criterion). A tv/o-dimensional space 
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( stress = .041 for the digraph; streris = .00!;; fo^? the graph) 
was selected i.n both analyses. In both cases the scaling 
solutions (see Fif^iires 5 & 4) match our imderBtar:iding o.r the 
instructional material. In exainining Pifiuro 5j for example, 
one finds that "outcome" is clustered with "experiment'^ and 
"event J " "probability" is clustered with "intersectio}i. " 
Examining larger clusters v/e see that "mutually exclusive," 
"independent, " and "intersection"/"probability" are related 
to "event," "trial" and "equally likely/" cluster v/ith "experi- 
ment "/"outcome* " Finally, "zero" is related most closely to 
"probability "/"intersection. " Thus there appears to be a 
clustering on the. basis of abstractness of the concepts. For 
example, '^experiment" is less abstract than "event. '^ The 
third cluster which includes "probability" gives us the uni- 
fying mathem.atical concepts. This fits nicely with the idea 
of probability being an abstract model of the physical world. 

P3:oblem solving . It is apparent from the analyses of 
variance results" of achievement data that each experimental 
group did significantly better (p < .01} after instruction as 
compared to before instruction. At the sam.e time v/hile control 
groups performed slightly better at posttest and retention 
test as comi)ared to pretest this difference was not significant. 
From the mean scores for each test occasion (see" Tables 10, 
11, & 12), we see that each experimental group was able to 
solve problems much better after instruction than before and 
this was not true for the control groups. The probability 
instructional material, then, produced learning of probab: lity 



and th.i. s learn.:l.])p; wan due solely to the inn t]:aic1.;ional 
material (i.e. a significant treatment ericct). Additionally, 
this leai^ninc was retained as Judged by retention test meana 
(in fact, eip;lith parade and higii school oxporiinental Ss per- 
formed better at i-etention test than at posttest). 

The analysis of variance which includes school level 
effect indicated that older Ss performed significantly better 
on the achievement test than did younger Ss. 

pLe,sulbs of correlation analyses . An examination of 
the results of the within experimental group correlation 
ajialyses leaves us with a somewhat less enthusiastic appraisal 
of the WA results. The mean/median RC matrices distinguish 
the experimental cind control groups vie 11 and in the same 
manner as the achievement data. Hov:ever , with the exception 
of the sixth grade data, v/e did not obtain a significant cor- 
relation between WA data and achievement data within an 
experimental group. 

The sixth grade data indicates that posttest achieve- 
ment was correlated significantly (p < .05) with retention 
achievement, post and reteiition V/A results, and ability 
measures (see Tsbles 18 & 19; note that the rank correlation 
coefficient was not significant for retention V/A data even 
though the prod.uct-mom.ent correlation coefficient v.-as). 
Retention acliieve^iient v/as not correlated sir:nif icantly v;it:: 
WA data; ability data was nob related significantly to WA data. 
Attitude toward mathematics vjas correlated significant I7/ with 
retention V/A data but nothing else. All intercorrelations . 
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among post aclrioveiiiGni; , retention achiGveijiont , and ability 
ineasuros v/ei'O r;:i.{_^.;;rjij;icant Tor the sixth gi^ado experimental 

Achievement data and WA data intercorrelations were 
not si[;;3'.iirican t Tor the eighth (^rade experimental group. 
The ability mearjure, Minimiun Essentials of liodern Mathematics, 
was not correlated sifjnif icantly with any other variable. 
Attitude toward mathematics was correlated significantly only 
with pretest achievement. All achievement data intercorre- 
lations v/ere significant. 

Neither abtituc3.e toward mathematics nor achievement 
data v;as cox-related signif ican.tly with V/A data within the high 
school experimental group. Attitude was not related signi- 
ficantly to any other variable. The only achievement data 
correlation coefficient that vias significant v/as the correla- 
tion betv/een post and retention achievements. 

Ability and cognitive structure after instruction v/ere 
correlated significantly in the sixth grade experimental 
group, but not in the eighth grade exjperiinent al group. . Since 
the ability measure in the eighth grade group was quite spe- 
cific aad there v/as a significant amoimt of missing data, the 
author is inclined to accept the results from the sixth grade 
grouj). This result agrees ivith Shavelson's (1^70) findings 
that some ability and V/A data are related. I-lowever, the 
reader is cautioned that patterns in the sixth grade correla- 
tion analysis did not appear in the other school levels and 
thus the link between ability and WA data is tenuous at best. 



Wo v/oro not able to dernonstrato corjsistently a si©;!!- 
I'icant relationship between cognitive structure after 
instruction and. either achieveraent , attitude, or ability 
within the orxpoi-irnen tal group .s. In gonerol, attitude toward 
mathematics was not related to other variables in the study. 
However, achievement data and WA data wei-e related strongly 
in the sixth grade experimental group. At the eighth grade 
and high school levels, achievement data and V/A data were not 
correlated significantly, but the correlation coefficient was 
generally in tJie cippropriate direction although near zero. 
Tlus finding is in agreement with past studies (cf. Johnson, 
1967; Shavelson, 1970)* It may be that the larger variation 
present in the sixth grade experimental group was the cause 
of that being the only group v/ith significant results in the 
correlation analyses. 

Thus it appears that tv/o possible interpretations of 
the V/A test results are possible: a) the -^-/A test provides a 
measu_re of group learning but not individual learning; b) the 
\'1A test provid.es a measure of learning and this learning is 
of a different type than learning to solve problems and thus 
the V/A results m.ay not alv;ays agree highly with conventional 
achievement results (much the same as attitude and achievement 
are not alwa7/s highly related). The author prefers the second 
interpretation, particularly since many of the problems on 
the achievement test could be solved by an algorithm, even if 
the student did not \mderstand fully the relationships between 
various concepts. (A third interpretation, the WA test does 
not measure learning of mathematical structure, was discounted 
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by tho autvhor cl.no to the strikinp; conf:.:i.,q;to,fi,oy of "tjoi;iA/oo.n 
treatjiient gi'oups j)ej.':rorrnaace on the WA test; and the consistency 
oJ' this di.rrei'once witli achievement tent di.LM'ei'oncoG. Also 
the results of the multidimenGio.nal r;calint'; jxrocedux'O in each 
experimental ^ronp iadicate learning of structure took place.) 

G 0 f-;Mi.i t i V e ^\ t r uc b ui'o . Examining tlie WA test results 
(see Fj.f^m'os 6-50) indicates that eighth grade Ss did best in 
terms of learning content structm''e but tliat both high school 
and eighth grade Ss performed better than sixth gi-ade Ss. 
Results of the PC test (see FigU3:-es 3-1^-^55) indicated that 
eighth grade Ss performed v;orst v;ith high school Ss performing 
best. The author: suspects that this result on the PC test 
is due pax'tly to the large number of uaiusaole results at the 
sixth grade level. That is, only the best achievers in sixth 
grade v/ere able to respond to the PC test and thus the meaai 
score was inflated. 

Thus, in general, there appears to be a strong matura- 
tion e^Tect on the test scores, k portion of this effect v/as 
probably due to older Ss having higher reading ability and 
more experience v;ith mathematics. Hov;ever, some of the .effects 
may be due to older Ss being able to retain or learn better 
the- abstract portion of the m.athematics. 

The pattern of ihtercorrelations betv.-een V/A results 
at di.i'fei'ent test times v/ithiii experimental groups also pro- 
vide some interesting observations. Posttest V/A resul.ts alv/ays 
were correlated significantly v/ith retention test V/A results. 
O stest V/A results v/ere correlated significantly vdth -ocsttest: 

ERIC 



WA i'or:;ultn at tho. n:i..xth f^'mde level ruicJ wore oorj'olabccl 
iiiricatitly wit;l:i l;ho .fobojvbioi) toGi WA rornilb:; at l.he otlior 
two c?chool level:,;. In the cacie of noji-ni (^^ni ricaiit rcGultn 
the cliroctiori ol' 1;ho correlation coorficioJit: wns ponitive and 
usually approachocl oignii'icatice. The corrolationfj b^tv/een 
postkcrt and rotontioii tevA, V/A recult.'j i'ui'bhor indicate the 
Gtability of loarninG of iriabhoniatical ntruoburo^ V/e suggest 
the relationship between before-instruc bion V/A dato and after- 
incti'ucbion V/A data indicates tliat Ss v;ore not able bo separate 
totally the coiranon moaning oJ.' tlio key coneopl;^ and the £i;eciric 
(inatlieniatical ) meariing of the concefjtn* Tliat is, v;hile the 
instructional material presents only the mathematical meaning 
of the key concepts, Ss "add" this extra luider standing of 
concepts to tiioir organization of concept:^ in rr:eniory but also 
retain the everyday meaning of the concepts. Thus instruction 
may produce only a change in the quality of concept organisa- 
tion in memory, but not necessarily cause S to reorganize 
radically his cogaitivo structure. 

Content sti'ucture versus cofrnitivo r^bnacture . Examining 
the Euclidean distance scores between the conteiib structure 
distance matrices and the mean/median RC matrices (see Tabl^ 
2^3) one observes the same pattern of learnini^ due to instruc- 
tion ar; v;as found in the achievement data. Tlie difference in 
learning betv/een experimental and control groups is also 
apparent in the RC and PC matrices* Thus it v;as concluded 
that experimental Ss were not only better at solving problems 
after instruction, but also learned some mathematical structure 
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(oG incaGurcd by llio VA md PC tostr,). Noto alGo Wiat cxperi- 
mciitnl Sf5* coc^iihivc stiiicturos v/ero moro like content; structure 
at retention tent than at poskter.l (see Toble 25). Thic 
demonstration oJ* a lanting change in co(5nitive structure is 
important Ginco prior ctudiec have not examined this. 

The Tact tlial; exper.-imen1;al Sn oxhihibod tho ycune 
general pattern, in teiTns of mean scores, on both achievement 
tests and cogJiitive structure tests and the after- instruction 
scaling solutions indicate that the cognitive structure tests 
measui^e learning (of mathematical structure). The learning 
of mathematical structure was x^otainod^ 

Forma tive^ evaluation . The results of the multidimen- 
sional scaling solutions provide tlie most useful information 
for formative evaluation. The resultant dimensionality of 
best fit and clurrtering of concepts provide a more easily 
interpretable description of the fiC matrices. 

Several patterns emerge from the best fit dimension- 
alities (sximmarized in Table 26). V/ith the exception of the 
high school control group's V/A retention test result, all - 
control group median RC matrices and all pretest median RC 
matrices contained too many sero elements for the obtainment 
of a scaling solution. (The high school control group at 
retention test liad a very small N and these students appeared 
quite intelligent wiiich probably caused this exception.) This 
strongly supports the hypothesis that Ss v/ere imfamiliar with 
probability prior to instruction and that the control group 
Ss did not learn the mathematical structure of the probability 



text. ' In ft-ori(;;rnl, the median RC Tnati'ic^r.; fit vjell in a smaller 
dimensionality than the meaai RC matrices. 

Table 26 

Dimensionality of Best l''it for RC Matrices 



Pre Post Ret 



Meaii Med. Mean Med. Mea.n Med. 
RC RC RC 



Sixth 
Gx'ade 


E:q) . 


/{. 




5 


1 


3 


1 


Coiu 


/}. 










* 


Eighth 
Grade 


EyC.p • 








2 


7. 


J; 


Con . ' 




* 




■* 


5 


* 


High 
School 


Ey:v. 


/.{. 






1 




2 


Con. 


2 




.'-I- 




5 


2 



* indicates iiiability to calculate a 
scaling solution due to a majority 
of the elements in the EC matrix 
being aero 



Follov/ing instruction, the experimental groups median 
RC matrices fit well in tv;o dimensions or less (except for the 
eighth grade retention test median RC matrix). Posttest and 
retention test mean PC matrices for experimental groups tend 
to fit well in three dimensions (except the high school post- 
test mean RC matrix). Also the mean RC matrices tend to fit 
in a smaller space following instruction as compared to pretest 
results especially in the experimental groups. 

It appears that relationships hetvjeen concepts not 
only approach that presented by text, hut also approach the . 
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same dimensionality. We conjecture that the third dimension 
in the mean EC matrices for experimental groups is necessitated 
hy the common meaning associations still present in Ss' memories 
after instruction. 

The sunmiarisation of best fit dimensions for the PC 
matrices is presented in Tahle 2/. Ko pattern exists for 
control groups as v/ould be expected. The e^rperimental groups 
results tend tov/ard three dimensions with the exception of 
the sixth grade experimental group. The experimental groups 
PC matrices seem to resemble the mean EC, matrices rather than 
the median EC matrices. 

Table 2? 

Dimensionality of Best Fit 
for PC Fiatrices 





Sixth 






Grade 


Con. 


* 


Eighth 


E>rp. 


5 


Grade 


Con. 


2 


Bigh 


E>rp . 


5 


School 


Con. 


4 



The scaling solution indicates hovi concepts v/ere 
cluste3?ed in Ss' cognitive structures. These clusters can be 
compared to the text structure and thus provide information 
as to which relationships Ss learned well and which ones they 
did not learn v/ell. V/e suggeist that this information m.ay be 
useful for formative evaluation. For example, examining the 



porrb and :i'c-) toiii.ioii r;cal:i.u|-'; fiorirbion.s (noo .lj'i(»;LLT'on G-J;0) for 
Gxperimontal Sr.^, we oee 1;hat the ovei^all j2;c;jnoral structure 
presented by text; appea:ps to be xjreserjt in Ss* iriGmories after 
instruction 5 but there appears to bo coni'mjion over the dis- 
tinction, between ^'outcome ^' and "event." Seve.ral scaling 
solutions show that "mutually exclunivo" and "independent" 
cluster with "outcome" x-ather than "event." V/e observe also 
that, in general, the central concepts ("event," "outcome," 
"experiment," "trial") are not well distinp;uished in Ss' 
memories. Thus Ss have learned the general structure present 
by text, but are lacking many refinements in this structure. 
In terms of formative evaluation, we would suggest more 
comparing/contrasting of central concepts be presented in the 
text. Note that this suggestion is quite dissimilar from 
suggestions that might arise from achievement test results. 
Achievement test results indicate areas of difficulty in 
solving problems and formative evaluation suggestions based 
on achievement tests are often stated in terms of problem 
solving practice or more explanation of algorithms. Results 
of the V/A test indicate v/hich relationships betv/een concepts 
need more emphasis regardless of whether the relationship 
involves problem solving. 

The only i.>attern the authoi' could discern for control 
group results was a tendency to associate concepts on the 
basis of familiarity. Here again the clusters indicate the 
control groujjs did not learn the probability text structure. 
The results also indicate that responses to the WA test by 
experimental Ss v/ere not a random phenomena. 
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I''u'bui'G Woi'k 

Be Tore pi/oceeding wi.th some suEgestions for futui^e 
research, it i,s 3iecessary to note some inappro[jriate uses of 
the cognitive structure instruments. From the experimental 
groups correlation a2ialyses, we conclude that the WA test is 
not a substitute for the usual achievemeiit test in terms of 
individual persons. While we feel that the WA test measures 
learning of mathematical structure, it is apparent that the 
WA test is not a good predictor of learning to solve problems. 
The V/A test does ai)pear to be a good predictor of achievement 
in terms of group means. 

Using the present scoring method, the PC test is not 
appropriate for predicting either the V/A test data or problem 
solving data on an individual basis. Unless an inordinate 
amount of testing time is used or else a different scoring 
procedure is used, the PC test should be used only for group 
distinctions and not individual distinctions. Secondly, it 
. appears that the PC test involves the "ability to write about 
mathematics" and this ability is not well developed in students, 
particularly at the elementary school level. This probably 
is due to lack of eyci^erience in v/riting about mathematics and 
the investigator feels this skill should be practiced more in 
the mathematics classroom. 

Finally, a simpler scoring procedure would be necessary 
if individual teachers were to use the WA and PC tests in 
their classrooms. Even with a computer, the task of putting 
the results into a2i interpretable form is quite time consuming. 

ERIC 
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'J?wo :i.ii);j)o:i:i;a.rrt: I'esoai'ch quor;tioru.) refaain be.f.'oi'co one 
could, put these procedures to general use, I'^irst, do imxxrove- 
ments to the text like those suggested above produce a 
correspondirif^; iiiiprovornent on the WA and PC t^csts? This 
question needs to be answered to assure the usefulness of the 
cognitive measures in Tormative evaluabion. The second problem 
of interest is whether a difl'erent stx^ucture of probability 
presented by text produces a different cognitive structure in 
the student. That is, v/e have shov;n that the text produces 
a* change in cognitive structure, but v/e have not shov/n whet]ier 
this chanpje is unique with respect to each particulai^ text 
structure or the same for all texts. 

Smmiary 

The purpose of this study was to define mathematical 
structux-e openrationally and to exairiine coimnunication of mathe- 
matical structure to students by text. Mathematical structure 
was defined as the relationships betv>?een concepts within a set 
of abstract systems. Content structure v/as mapped by digraphs, 
graphs, and task analysis. Cognitive structure in S's memory 
v/as measured by the wo.rd association technique and the paragraph 
coTistruction teCi:iniquo. Ss (,N=180) participating in the study 
were from the ;-*ixth grade, ej.ghth grad^j , and high sc^hocl 

(grades 9-12) levels. Ss were divided .raadorcly i.nto experi- 

mental and conti/oi groups at each schoo]. level. Experimental 
Ss read a programmed text concerning eleiDentaiy probability, 
wliile control Ss read a prograiiimed text concerning mathematics 
not related to probability. The e:q:)ei'iment was conducted 
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dux-^irjg rof';ulaT' ;-5Cihool hours and, i]i moct crtso:^, , in the regular 
juatheijia bic n cla^^j iji'ooin . Tho expernjiierit law U.^d ajppi'oxi inately 
two v/eeks pliu-; a retention test period. Ss v/ere pi'etested 
viith attitude tov/ard matheinaticG , achie'vement in probability, 
and V/A initruinents ; posttested v;il:h v/A, achievement, and PC 
instriunentrj ; and i-etention tested with V/A wd achievement 
instruments. Experimental Ss scored signiTiccmtly better on 
the achievement test at post and retention test times as com- 
pared to protei^:t. Experimental Ss scored significantly better 
at post and retention test times than did control Ss. Digraph 
ajialysis and graph analysis provided representation of content 
structure that v/ae interpretable and agreed v;ith o\xr under- 
standing of the instructional material. The v/ord associatio2'i 
and paragraph construction techniques v/erc useful in examining 
the learning of mathematical structm.-'e at all levels. Experi- 
mental Ss' cognitive structures resembled the content structure 
follov/ing instruction; this was not true of control Ss. It 
was concluded that ey:p>erimental Ss learned hov/ to solve proba- 
bility i)^'oblem.s and learned a significant portion of the text 
structure as a result of instruction. There was both a treatment 
group and school level difference on the acliievement , VJj\^, and 
PC tests. The WA and PC tests appeared to be useful for 
for^hative evaluation and gave different information than did 
the achievement test. 
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ACM IEVKMEMT T.ES'1 



LNBTIiUGTIOWS 



Thirs ir\ t\ ior:l: nboul probal^iliiy . You v/LII hnvo all the time 
you nu'cd. Lo r.iriL;'.li l.]io l,orvt, RoHd the qu(r,'A:iovir:] carGlully 
and oncv/er theni Lo the best of your abili l;:y. 

Plrnre Lr;/ uJ.l Lb':. querU:io.nr. . !lov;o vo:r , J T ;/oii I'ImcI nome qi,ios- 
tion:; boo liarcl , Icnmvo them until you br^vo oi.ov/eT.'od bhc earlier 
ojion. Then you liiay come back and try t;h(: harder ones. Try to 
do blio best you caru 

The quostionr^ are o.t' tv/o typer:; 

1) In tlio cr:q)erimejit o i* l;osr:iii[^ a f.'ai.i; coin , 

P(Jle'jds) = 

2) lu the experiment of tossing a fair coin , PvHeads) equal 

(A) 1/2 (B) 5/-'- (C) 1 (D) none of these 

In quer* tioni:-; like quer^tion 1 you arc- to put; your an£:v;er in the 
cpace provid'^/d. In quer: -jiorj .like qiie:':tiori 2 you are to circle 
the letter in front of thic correct ansv.'er. Circle only one 
an :r/v-/ei* for e ach que s ti on . 

In the example quoGtions above, your ansv/ers vjould look like: 
1} In the experiment of tossing a fair coin, 

P(Heads) = ^/^ 
2) In the e>:poriment of toG.sing a fair coin, P(h'ead's) equa 
1/2 (B) 5/4 (C) 1 (Ij) none of these 




Are there an;/ quer; Lions abou.t what you arc supposed to do? 
You may turn the page and begin. 



1^2 



1. Suppor^e you were going to pick a marble out of a bag that 
was riirecl. vyith 10 white iriarbles, 8 green marbles, 
aiKl. ^-v red marbles. 

What is the probability ol picking a green marble? 



2. The face oT the spinner below is^ divided into 8 equal areas. 



What is P(Z)?. 

3. A teacher wrote the numbers 1 , 2 , 3 ^ !3 , 7 ^ 8 , 10 on the 

blackboard, and said "I am thinking of one of these numbers. 
What is the probability that she is thinking of an even 
number? 

^v. There are 9 possible outcomes for an e>rperiment. The 
event "Blue" contains 6 of the possible outcomes. V/hat 
is P(Blue)? 

5. A bag contains 13 marbles* P(Blue) = 1/5- How many 
blue marbles are in the bag? 

6. You have a box containing 50 tennis balls. Some of the 
bf'iills are rod ar.)d r.-^ome are v;}iite* If you dravj a ball 
from the box (v/ithout looking), P(Red) = 1/3- How many 
white tennis"; balls are in the bag? 

7. If you toss two coins, P(at least one Head) = . 

8. If you to.v;o bhree coins, P(at least one Tail) = . 
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Conuider the o>;j)(M'.i.iiien I: of :;;p.uii:i;i.ng both tl'ie :v.pinner;:, below 
(Quer.tions 9-l'i)- 




9. Draw the tree diagram and list all the possible outcomes 
of the ex.;perinient . 

Tree Liap;ram Outcomes 
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10. P(at lea:.'. I oiio Groen) = 



.11. P(exactl;y one White) = 



12. P(at learvl; one White and no Green) = 



15. List the outcomes in the event "No Blues". 



J 
i 

14. List the outcomes in the event "at least one Red". 




15- Draw e tree diagram showing all possible outcomes 
experiment . 



V-\S 

16. P(di.l.'j:o:t.T>nl.; color on each r.^piri) = . 



17. P(no Pui'ples) = 



18. List the outcomes in the event "at least one Rirple". 



19. Are the two events "at least one Orange" and "at least 
one lellov/" independent? 



20. Are the two events "at least one Orange" and "at leasi 
one Yellow" miitually exclusive? . 
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CoriGxcler the experiment of drawing twice from a bag of marbles. 
The bag conLains two red marbles and. three black iiiarble r,. 
(QuentionG 21-2/1 ) 

21. If you do nob put the marble you picked on the first 

draw back in the bag before making the second draw, then 

P(R,B) = . 



22. If you 00 put the mai'ble you picked on the first draw 
back in the bag before making the second draw, then 

P(B,R) = . 



23- If you do not put the marble you picked on the first 

drav/ back in the bag before making the second draw, then 

P(at least one Red) = 



If you do put the marble you picked on the first draw 
back in the bag before making the second drav;, 

PC same color on both drav/s) = 



25- Vihat do we mean v/hen v/e say that txvo events are independent 



1-^18 

26. VJhat do we jnean when we say that two evenbs are imtually 
exclusive;? 



27^ If you toss a coin twice, P(No Tails) = 



28. ir you tosrr. a coin three times, what is the probability 
of getting three Heads? . 

MULTIPLE CHC.ICE - Circle the correct answer. 

29* An event is a set of 
(A) pi'obabilities 
( B ) e xpe r i in en t s 

(C) outcomes 

(D) fractions 

(E) none of these 

30. The number of of the experiment refers to 

the nuiriber of times, we I'ej^eat the experiment. 

(A) outcomes 

(B) events 

(C) dice 
(B) trials 

(E; no/ie of these 



Each of the 16 dots represents a 
possible outcome of an experiment. 
Assiuno tlie outcomes are equally 
likely. (QaeKtioii.'j 51--35) 




51. A pair of eventr; that ia independent is 

(A) A,B (B). B,C (C) A,C (D) A, A (E) None of these 



52. P(A) = 

(A) /-!• (B) 1/2 (C) 1/4 (L) 5/16 . (£) Kone of these 



35. P(B and C) = 

(A) 5/8 (B) 1/4 (C) 2/6 (D) 2/16 (E) None of these 



34. A pair of events that is mutually exclusive is 

(A) A,B (B) B,C (C) A,C (D) A, A (E) None of these 



55. F(not-A) = 

(A) 1/4 (B) 3A (C) 1/2 (D) 5/8 (E) None of these 
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Test 1 



List the possible outcomes of spinning the spimier below. 




A -pirs-er h^.s th- nurnberr: > i;V:ro^;rr: H printed or 
List the possible outcomes in the event "a naunber less 
than 12". 



How inan.y po}ji.';i'h].o oubcoJiios aro tliere foi' the oxperiinent 
o.l f I f I j I (f'i 'I'ho r;j ri nor \}() low V 



(A) 0 (B) 1 (C) 2 UO '^i- (£) .none o.r therje 

I,r the .face o.r a npinrier is all blue PCKed) = 
(A) 1 {B) 1/2 (C) 0 (L) uncertain 

If the probability of Bed on a spinner is equal to 1, 
v;hich of the following must be true? 

(A) Spinjier might be blue (B) Spinner could have 

tv;o colors. 

(C) Spinnor is all red. " (D) i.'ot sure of the color. 

A bag has 6 marbles in it. Some are red and some are 
black. How many black marbles must be in the bag if 
P(Red) = P(BlaGk)? 

(A) 2 (E) 5 (C) (D) 6 (E) can't tell 
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A b£\{5 con(;a:uuj 5 J^'f^d and 6 [i;reG.n marblos. You pull 
one jfiai'blo out. A.rter that, the p.ro"bab:Llit.y ol' pialling 
out a red marble is 2/!;?. The color oI the marble you 
pulled out is: 

(A) red (B) green (C) could be either red 

or green 

(D) don't knovy 

III the oxper.iment of throv/ing a fair die, P(number 
greater than 5) = • 

A bag contains eleven marbles. The marbles are numbered 
1 to 11. In the e:q:)eriment of drawing a marble from 
the bag, vniot is the probability of picking a marble v/ith 
an even number? 



A bag contain?: eight marbles. Some are red and som.e are 
black. P(Eed) = 1/4- Hov; many black marbles are in the 
bag'r 

(A) & (B) ^-1 (C) 2 (D) 1 (E) none of these 
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Tost 2 



Think of the experiment of tofjcing two dice, a red one and 
a v/hite one. 

1. Which of the following are the same outcomes of the 
experimen t? 

I. II. III. . I'^- 

(6,2) (2,6) (?,1) (2,6) 

(A) I and II 

(B) II and IV 

(C) 1, 11, and IV 

(D) I, II, III, and IV 

(E) Wone of the outcomes are the same. 



ERIC 




2. bruvi the Iroc diagram and list all the i^ossiblo outcoincG 
of the oxpei'imont. 



5. P(H,W) = 



/|. P(al. l.c\'.ir;t one v/lnte) = 



^j,, P(oxackl,y -rod) = 



6. List the outcomes in the even': "IIo Groens". 



* * 



7. "J J' you tor-G three coins, P(exactly one Head) 
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8. I.f you Lo.'ir-: Miroe ooi.ns, .P(;,vt; least U;o Iloadr;) = 



9. -A bag contains one blue and one white marble. One 
marble if; removed from the bag and a coin is tossed. 
Wliat is P(W,T)? 
(A) lA 
(10 V' 
(C) 2/2 
CD) 1/2 
(E) 0 



10. A bag contains 5 green marbles, 2 blue marbles, and 
1 black marble. Joe draws 1 marble and gets a black 
one. He does not put the black marble back in the bag. 
V/hat is the probability that the next marble he draws 
will be green? 

(A) 3/6 

(B) 5/l> 

(C) 2/6 
CD) 2/5 
(E) 0 
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^Hfxndoin Orders of Key Coricepl;.^ Tor 
Word Association Test 



1 

intersection 
outcome 

mutually exclusive 

trial 

event 

experiment 
independent 
equally likely 
probabi lity 
zero 



2 

independent 
trial 

probability 
equa].ly likel^;/ 
mutually exclusive 
outcome 
even t 

intersection 
zero 

( xperimerit 



5 

probability 
intersection 
independent 
equally likely 
trial 

experiment 

event 

outcome 

mutually exclusive 



probability 
independent 
trial 

inter.section 

mutually exclusive 

e^-rperiment 

equally likely 

zero 

oubcome 
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Kirnciorn Ordern for Co.ncop1:-PaaT.'r..; :\'or 
Paragraph Constructioii Te:i;l:j:; 

PC Test 1 



experiment - ;'.ei"0 

outcome - i,ridGp'::/Klo.n t 

probability - event 

trial - in terr^ection 

equally likely - mutually 
exclusive 



outcome - independent 

ti\ia 1 - intersect ion 

expei'iment - xex'O 

probability - event 

equally likely - mutually 
exclusive 



'J 

equally likely - mutually 
exclusive 

probability - event 

trial - intersection 

experiment - zero 

out: come - independent: 

PC Test 2 

1 

zero - equally likely 
trial - indei:)endej] t 
outcome - mutually exclusive 
event - .intersection 
probability - exi.')eriinent 

5 

y^ero - equally likely 
event - int en? section 
probability - experiment 
trial - indepi::;r-.dent 
event - intersection 



equally ■ likely - mutually 
exclusive 

experiment - zero 

ou t c o me - in d e p e nden t 

probability event 

trial - intersection 



2 

probability - e:cperiinent 
trial - independent 
event - intersection 
zero - equally likely ■ 
outcorae - mutually exclusive 

4 

outcome - mutually exclusive 
event - intersection 
trial - independent 
probability - experiment 
zero - equally likely 
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Appendix B 

Numerical Results o.r Multidimensional 
Scaling Solutions 



ERIC 
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MultidimenGional Scalinf^; Solution 
for Digraph Similarity Matrix 







l''inal Configxiration 
2 Dimensions Stress = .O-'-ll 


Sorted Configurations* 
Dimension 
1 2 


Prb. . 


0.005, 


-0.768 


Ind. 


Zero 


Ind. 


-1.245, 


0.115 


n.E. 


Prb. 


Event 


-0.261, 


0.176 


Zero 


Int . 


Zero 


-0.474, 


-1.411 


Event 


Exp. 


E.L. 


1.355, 


0.538 


Int.. 


Ind. 


Int. 


-0.144, 


-0.527 


Prb. 


Event 


Tr. 


' 0.454, 


0.928 


Tr. 


Out. 


Exp. 


0.671 


-0.055 


Out. 


E.L. 


M.E. 


-0.853, 


0.797 


E>c}) . ■ 


M.E. 


Out. 


0.466, 


■ 0.209 


E.L. 


Tr. 



These are the resultant orderings (from negative to 
positive) of the key concepts along each dimension 
of the multidimensional scaling solution. 



Mu].i;:i, dimensl onal Scaling So lut ion 
Tor Graph Simila.ri tj Matrix 







Final Configuration 
2 Dime.nsioi:s Stress = .005 


Sorted 
1 


Configurations 
Dimension 

2 




0.591, 


-0.486 


E.L. 


Zero 


Ind. 


-0.1S2, 


1.314 . 


Out . 


Exp . 


Event 


-0.022, 


0J-IS6 


Tr. 


Prb. 


Zero 


0.y-|.2, 


-1.265 




E.L. 


E.L. 


-1.32S, 


-0.464 


Ind. 


Int. 


Int . 


0.506, 


-0.148 


Event . 


■ Out. ■ 


Tr. 


-0.^1-60, 


. 0.281 


R?b. 


Tr. 


E:q-; . 


-0.326, 


-0.759 


Inb. 


Event 


M.E. 


0.963, 


0.831 


Zero 


M.E. 


Out- 




0.209 


M.E. 


Ind. 
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Mul'bidimonrdoiial Scaling Solution for Six1;li Grade 
Experimental >Sub-jects ProteGt Fioari 
Rolatedriess Coefricienb Matrix 







Final Conliguration 
^1- Dimensions Strerss = .010 


Soi-'t;Gd Configurations 
Dimension 
123 4 


Prb. 


-0.303, 


-0. 51-'!-, 


-0 . YA , 


-O.353 


E , Xj • 


Zero 


E.L. 


E.L. 


Ind, 


0.153, 


0-.i|-34, 


-0.405, 


-0 . 080 


Ev ent 


E.L. 


Ind. 


Prb. 


Event- 


-0.32^1, 


0.262, 


0.264, 


-0.200 


Prb . 


Prb. 


Prb. 




Zero 


-0.162, 


-0.781, 


0.236, 


0.169 


Exp . 


Out. 


M.E. 


Int. 


E.L. 


-0.766, 


-0.625, 


-1.013, 


-0.701 


Zero 


Exp. 


Int. 


Event 


Int . 


1 . 080 , 


0.255, 


0.148, 


-0.290 


M.E. 


Tr. 


Zero 


Tr. 


,Tr. 


-0.058, 


0.179, 


0.381, 


-0.102 


Tr. 


Int. 


Event 


Ind. 


Exp . 


-0.253, 


C.155, 


0.556, 


-0.295 


lud . 


Event 


Tr. 


Zero 




-0. W-5, 


0.372, 


-0.325, 


0.904 


Out . 


Ind. 


Out . 


M.E. 



Out. 0.777, -0.215, 0.512, 0.945 Int. n.E. ExiD. Out. 
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Multicliiiiensional Scaling Solution Tor Sixth Grade 
Exporiinental Subjects Posttest Moan 
Relatechiess Coefficient Matrix 







Final 
5 Dim en si 


Gonf igLiration 
ons Stress = .058 


Sorted 
1 


Configurations 
Dimension 
2 5 




0,258, 


0.102, 


0.05.6 


Zero 


E,L, 


Int. 


Ind. 


-0. 122, 


■0.979, 


-0.629 


Out. 


M.E. 


M.E. 


juven 1/ 


-0.22;;, 


-0.567, 


0.487 


±oxp. 


Event 


Ind. 


Zero 


-0.89^1-, 


-0.158, 


-0.590 


■ Event 


Zero 


Zero 


E.L. 


0.810, 


-0.975, 


0.215 


Ind. 


Exp. 


Prb. 


Int. 


0.759, 


0.527, ' 


-0.978 


Tr. 


Erb. 


E.L. 


Tr. 


0.075, 


0.555, 


0.714 


M.E. 


Out. 


Out. 




-0.270, 


0.015, 


1.056 


Rrb. 


Int. 


Event 


M.E. 


0.195, 


-0.781, -0 


.670 


Int. 


Tr. 


Tr. 



Out. -0.585, 0.505, O.56O E.L. Ind. Exp. 



Miilti dimensional Scaling Solution for Sixth Grade 
Expo i.\lino:rital Sub J nets Poattor;t MofliL.ui. 
Itelatediiess Coeiriciont Matrix 







l*'inal Configuration 
1 D'iTTipn'^'i nn KIvpp'^i^; = 0 0 

-t- ■t-' .Li llv^ll fc..' J. k> U J. ^ O O \.J m ^.J 


Sort? 


?d Configuration 
1 


Prb. 






Out . 


Ind. 


-0.039 




Event 


Event 


-0.595 




Zero 


Zero 


-0.059 




E.L. 


E.L, 


-0.059 




Tr. 


Int. 


0.298 




Exp. 


Tr. . 


- -0.059 




" M.E. 


Exp. 


-0.059' 




Ind. 


M.E.- 


-0.059 




Int. 


Out . 


-1.902 




Prb. 
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Multidimorisd.onal Scaling Solution for Sixth Grade 
Experimental Subjects Retention Tect Mean 
Relatodness Coefficient Mati'ix 



Pinal Confifjux^ation Sorted Configurations 

3 Dimensions S'\.Tess = .055 Diinensioji 

:l 2 5 



Frh. -0.061, -0.150 E.L. Zero lUE. 



1ml. -0.^1-68, '0.875, -0.461 Ind. Out. Zero 



Event 


-0.161, 


-0.116, 


0.751 


Prb. 


Int. 


Ind. 


Zero 


0.670, 


-0.865, 


-0.912 


M.E. 


Event 


Prb. 


E.L. 


-1.150, 


0.165, 


0.599' 


Event 




Int. 


Int. 


1.530, 


-0.517, • 


0 . 104 


Out. 


E.L. 


Out. ■ 


Tr. 


0.257, 


0.181, 


0.512 


Ex^p. 


Tr. 


E.L. 


E>rp. 


0.155, 


0.542, 


0.57^-1- 


Tr. 


n.E. 




11. E.^ 


-0.350, 


0.264, 


-0.929 


Zpt-o 


Exp . 


E:cp. 


Out . 


-0.116, 


-0.469, 


0.130 


Iiyi;. 




Event 
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Multiditin.maionEil Scaling Solution lor Sixth Grado 
Experiniontal Subjects Retontj.on Tcs'l: Median 
fielatednc^Gs Coefficient Matrix 







J. j.jid.1 uuiij. .1. [i,u.x d G J. on 
1 Dimension Stress = .009 


jjux utju ooiij. ±^ux c' ''1. on 
DimenEdon 
1 




0.766 


E.L. 


Ind. 


-0.030 


Zero 


Event 


0.730 


Ind. 


Zero 


-1.8^1-5 


I'l . E . . 


E.L. 


-1.969 


Int.: 


Int. 


0.250 


: - Tr. 


Tr. 


0.685 ' 


', ■ E:q). 


Exp. 


0.705 ' : 


Event: 


M.E. 


„ -0.030 . 


Out. . 


Out. 


; , ■ 0.759 : ^ 
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Multidlineii sionol Scaling Solution for Sixi;li Grade Control 
Sub;jGctG ProtofT/t: Moran RelatcdncDs CooJ'f i.ciont Matrix 







li'inal Gonligurati on 
'I- Dimensions ^Stress = . 


012 


Sorted Configiirat- 
Dimension 
125 


-UCi 0 

M. 


Prb. 


-0.574, 


-0.212, 


-0.785, 


0.147 


Tr. 


Int. 


Prb. 


E.L. 


Ind. 


0.595, 


0.562, 


-0.679, 


0.051 


Zero 


Zero 


Ind, 


Out. 


Event 


0.418, 


-0.5''-i4, 


1.175, 


-0.004 


Prb. 


Event 


Int. 


Zero 


Zero 


-0.^-!;5, 




-0.226, 


-0.119 


Exp. 


E.L. 


Zero 


Event 


E.L. 


-0-222, 


-0.280 , 


" -0.159, 


-0.745 


E.L." 


Erb . 


E..L. 


Exp. 


Int. 


, 0.795, 


-0.711, 


-0.612, 


/0.575' 


Out. 


M.E. 


M.E. 


Iiid.' 


Tr. ■ 


-0.859, 


0.800, 




6.159 


Ind, . 


Out.^ 


Out., , 


Prb.- 


Exp . 


-0.545,, 


■ 0.426, 


, , 0.790, 


O.OIO- 


M.E. 


Exp. 


Tr.' ■ 


Tr. 


M.E. 


0.-^16, 


0.051, 


-0.019 , 


0.761-; 


■ Event 


Ind. 


Exp. 


Int'. 



Out. .0.199, 0.207,.' 0.086, -0.65:^' ■■■I^^^^^^^ Tr. : Event M.E. 
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Mult:i(l:Lmonnio.nal ScQl.inc Solution J/or Sixt;h Grade Control 
SubjoctG PosttoGt Mean Eolatediiosn Coorriciont Matrix 







Final Conlif^iiration 
5 Dimensions Stress = .053 


Sort; 'J 
1 


d Configurations 
Dimension 
2 3 


X^.l. U m 


0.556, - 


■0.285, 


-0.731 


V T. 


Zero 


E.L. 




-0.016, 


0.928, 


0.183 


Ejcp . 


Out. 




EvGiit 


-0.159, - 


■0.564, 


1.539 


UUt . 


Event 


Zero 




0.080, - 


■1.077, 


-0.369 




Prb. 


H.E. 


E.L. 


: -0.827, 


0.154, 


-0.856 


Event 


E.L. 


Tr. 


Int. 


0.644, 


0.396, 


-0.157 


l2id . 


Exp . 


Int . 


Tr. 


0.685, 


0.547,' ■ 


-0.224 


Zero 


■ M.E. 


Ind. 


E>rp.- 


-0.506, 


0.200,' 


0.637 


Pr'b . 


Int. 


Out. 


M.E. 


-0.216, 


0.348, 


-0.-359 


Int. 


Tr. 


Exp. 


Out. 


-0.239, - 


-0.847, 


0.546 


. Tr. 


Ind. 


Event 



it 

id 
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MiiH;iditnenniona;i Scaling Solubioii Tor Sixth Grade Control 
Subjectn Rctajibiou TcgI: Mctm Bolatodruu;.'.; Ooorriciorib Matrix 







Final Conriguration 
3 Dimon.': 1011.0 Stress = .0^14 


Sor'teci 
1 


Con.figi.iral; ons 
Dim en si on 

C 'J 


Prb. 


-0.877, 


0.599, 


-0.^112 




E.L. 


Zero 


Ind. 


■ -0.359,.. 


.1.025, 


0.116 


Out. 


Zero 


Prb. 


Event 


-0.515, 


-0.527, 


0.634 


Event 


Event 


Int. 


Zero 


-0.550, 


-0.599, 


-0.826 


Ind. 


Out. 


E.L. 


E.L. 


0.657, 


-1.459 7. 


-0.205 


Zero 


PI.E. 


W.E. 


Int. 


0.806, 


0.359, 


-0.382 


Exp. 


Exp'.' 


Ind. 


Tr. 


0.454, 


0.701, 


0.187 


Tr. 


Int . 


Tr. 


Exp. 


0.085, 


0.111, 


0.353 


H.E, 


Pr-b. 


EX]D. 


M.E. 


0.522, 


-0.086, ■ 


-0.090 


E.L. 


Tr. 


Oub . 


Out;. 


-0.523V 


-0.323, 


0.626 


.In I;. 


Ind- 


Event 



ERIC 
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Muli:idiniojir;:i.onaI Scaling Solirbion' ro.r Eif^hth Grade 
E>:T»or:i.jneiital Subjects Protost Moon 
l?olal;ofl!io.sG Coorficieni; Matj-ix 







J: .l.il 

^ DijTieii 


al Configuration 
rdonn Strens = 


.028 


Sorted Confifjurations 
Diinonsion 
125 




-0.225, 


-0.2W , 


-1.028, 


-0.440 


Ind. 


Zero 


Rrb. 


Out; . 


Iiid. 


-0.956, 


0.2'(14,. 


0.061, 


-0.085 


. Pi-b . 


Out. 


E.L. 


R?b. 


Event 


0.152, 


0.018, 


0.880, 


-0.047 


n.E. 


E.L. 


n.E. 


Tr. 


Zero 


-0.150, 


-0.9A-8, 


0.005, 


0.085 


Zero ' 




Out. 


Ind. 


E*L* 


-0.089, 


-0.502, 


-0.747, 


: 0.455 


EaL. ■ 


. Int . 


Zero 


Event 


Int. 


0.55^1-, 


0.016, 


0.777, 


0.260 


Event 


Event 


Ind. 


Exp. 


Tr. 


0.166, 


0.961, 


0.472, 


-0.572 


Tr. 


Ind. 


Exp. . 


Zero 


Exp. 


0.515, 


0.555, 


0.240,' 0.054 


Out. 


Exrp. 


Tr. 


Int. 


n.E. 


-0.206, 


0.416, 


-0.459, 


0.955 


Exp. 


Vi.E. 


Int . 





Out. 0.258, -0.554, -0.221, -0.827 Int. Tr. Event M.E. 
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MuH;id:Linonf5ioanl Scaliiic Solul;lon J'or Eifdith Oracle 
E:q)n.ri inontal Subjocbr. Porvb Lorjt; Hoon 
RoltitednoGS Cocr.ric:Le.nt Matflx 







F:i nnl 
5 lJinioii;;i 


Conri|2;uratioJi 
one SLi'onn = .05I 


So r tod 
1 


Corificairaticno 
Diinonfjion 
2 5 




0 . 108 , 


-0.118, 


0.045 


Tr. 


Zero 


E.L. 


Ind. 


0.521, 


■0.829, 


0.087 


Out . 


Out . 


n.E. 


Event 


-0. 501 , 


0.115, 


0.155 • 


7..L. 


Prb . 


Int . 


Zero 


-0.006, 


-1.562, 


0.095 


■ Ex]"). 


Int. 


Prh. 


E.L. 


-0.5^4, 


0.484, 


-0.774 


Event 


E3Cp. 


Ind. 


Int. 


1.654, 


-C.II5, 


-0.194 


Zero 


Event 


Zero 


Tr. 


-0.645, 


0.467, 


0.422 


Pi'b . 


n.E. 


Event 


Exp. 


-0.495, 


-0.004, 


0.565 


li.E. 


Tr. 


Out. ' 


N.E. 


C.559, 


0.259, 


-0.584 


Ind. 


E.L. 


Tr. 



Out. -O.6I3, -0.553, ■ 0.290 Int. Ind. ijcp. 
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Fiultid:i,n)0.n:'"i or]<*al ocaling Golutj on Joj' Eighth Grade 
Exi)ori [nnni.ul Sul;;jocLr; For;U:o::l; MrMlian 
i^j J. a t e cL 1 G r; 3 Ooe L' li c i oi i l: 1'j a .i ' :i >: 





Ji'i n ol Coni"i[';arn ti. on 
2 JJiirif-.-nriioiir; oi,j-o:;r; = .010 


1 


I. Conf ip;urat;ionn 
JJirnoii^ji on 

2 


X J, • 


0.154, 


-0.118 


J.J ^1 • 




Ind . 


-1.228; 


0.528 




N E 

J i • Xr • 


X J V Cj; i t 0 


0.155^, 


-0.025 




X X u . 


Zero 


0.10^1- , 


1.280 




EvGn t 


E* L* 


-0.161, 


-1.585 


• 

Exp. 


Out. 


Inb. 


l.?02, 


0.299 


Tr. 


Exp. 


Tr. 


0.152, 


- 0.052 




Tr. 


Exp . 


0.129, 


0.005 


Event 


, Int. 


M.E. 


-1.20s, 


-0.442 


Oub. 


Ind. 


Out. 


, 0.265, 


0.005 


Int. 


Zero 
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Multicli.iiusnr'.ional Scaling Solution I'or Eiglith Grade 
Experijno.ni:u.l SubGects IiGtention 'HerA: Mean 
RolatcdnesE Goe.f.'ficio.n b Matrix 



■ Pinal Conf igiiro L'ion Sorted Conf indurations 

3 Diraenf.u.onG Stj^ess = .O'bl Dimension 

12 5 



Pi'h, 0.042, -0.125, 0.172 Zero Zero M.E. 



Ind. -0.251, -1.040, -0.726 Out. E.L. Ind. 



Event -0.187, 0.118, 0.472 Ind. Prb. E.L. 



Zero -1.261,. -0.96^, 0.247 Event M.E. In-t-. 



E.L. 


0.047, 


-0.527, 


-0.711 


Exp. 


Out. 


Prb. 


Int. 


1.640, 


0.209, 


0.111 


Prb. 


Event 


Zero 


Tr. 


■ 0.0^15, 


0.150, 


0.544 


Tr. ■ 


Exp. • 


Out. 


E>rp. 


-0.058, 


C.I50, 


0.416 


E.L. . 


Tr. 


Exp. 


p.E. 


O.58I, 


0.021, ' 


-0.904 


M.E. 


• Int. 


Event 


Out . 


-0.595, ■ 


0.026, 


O..579 


Int. . 


Ind. - 


Tr. 



Multidimensional Scaling Solution for Eighth Grade 
Experiinontal Subjectrj Retenl:ion Ter/t Median 
HelatednesB Coofficient Matrix 







li'inal Configuration 
5 Dimensions Stress = .0-^1-3 


■ Sorted Confiijurations 
Dimension 
1 2 3 


Prb. 


0 . 108 , 


-0.077, 


0.257 


Ind. 


Zero 


Int. 


Ind. 


-0.772, 


-0.653, 


-0.855 


Tr. 


Int. 


Ind. 


Event 


■ -0.319, 


0.041, 


0.403 


Exp. 


Erb. 


E.L. 


Zero 


.' 0.052, 


-1.311, 


0.672 


Event 


E.L. 


n.E. 


E.L. 


0.49^-, 


-0.012, , 


-0.762 


Out . ■ 


Out. 


Prb. 


Int. 


1.069, 


-0.577, 


-0.912 ■ 


Zero 


Exp. 


Event 


Tr. 


-0.361, 


0.0^f4, 


0.495 


Frh. 


Event 


Out. : 


Exp. 


"c- -0.330, 


0.039, 


0.446 


M.E. 


Tr. 


Exp.' 


n.E. 


0.379-, 


1.211, 


-0.153 


E.L. 


Ind. 


Tr. 


Out. 


-0.319, 


-0.010, 


0.410 


Int. 


M.E. 


Zero 
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Multidimensional Scaling Solution for Eig:hfch Grade Control 
Subjects Pretest Moan Relateclness Coerriciont Matrix 







Final Configuration 
4 Dimensions Stress = 


.027 


Soi'ted Configurations 
Dimension 
1234 


Prb. 


0.505, 


0 . 564 , 


-0.088, 


-0. 


550 


Ind. 


Out. 


Zero 


Tr. 


Ind. 


-0.772, 


0,778, 


-0.548, 


0. 


052 


E.L. 


E.L. 


Ind. 


E.I. 


Event 


0.2S2, 


-0.527,. 


0.625, 


0. 


0.89 


Zero 


Zero 


E.L. 


Exp. 


Zero 


-0.218 , 


-0.511, 


-O.7I6, 


0. 


565 


Out. 


Int. . 


Prb. 


Prb. 


E.L. 


-0.515, 


-0.559, 


-0.505, 


-0. 


575 


Exp. 


Event 


Int. 


Int. 


Int. 


0.958, 


-0.571, 


-0.059, 


-0. 


160 


H.E. 


li.E. 


li.S. 


Ind. 


Tr. 


0.071, 


0.785, 


0.542, 


-0. 


812. 


Tr. 


Exp. 


Out. 


Event 


Exp. 


. -0.121, 


0.345, 


0.628, 


-0. 


593 


Ev:enb 


Pi'b. 


Tr. 


Zei'O "' 


M.E. 


0.015, 


0.250, 


0.089, 


0. 


988 


Prb. 


Ind. 


Event. 


Out . 



Out. -0.185, -0.750, 0.214, 0.574 Int. Tr. Exp. M.E. 
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MultlcLi menGional Scali.ng Solubion for Eigh bh Grade Control 
Subjects Pof-'.ttost Mean Rolatedness Coern.cient Matrix 







.Final Configuration 
L\- Dimencj.ons Stress = 


.022 


Sorted Conf igxa'-ations 
Dimension 
1254 


trb. 


0.098, 


-0.126, 


0.1V1-, 


0.110 


M.E. 


E.L. 


Zero 


Out. 


Ind. 


-0.555, 


0.335, 


-0.507, 


0.355 


E.L. 


Zero 


Ind. 


Event 


Event 


. -0.193, 


-0.186, 


0.651, 


-0.555 


Ind. 


Event 


Out. 


Exp. 


Zero 


-0.048, 


-0.301, 


-1.069, 


0.412 


Out. 




E.L. 


Int . 


E.L. 


-0.568, 


-1.090, 


-0.09 


0.166 


Event 


Out. 


Int. 


Tr. 


Int. 


1.485, 


0.158, 


-0.059, 


-0.017 


Zero 


Tr., 


n.E. 


Prb. 


Tr. 


0.454, 


0.045, 


0.816, 


-0.005 


li-b. 


Int. 


Rrb. 


E.L. 


Exp. 


0.236, 


0.487, 


0.244, 


-0.450 


Exp. 


M.E. 


Exp. 


Ind. 


M.E. 


-0.600, 


0.204, 


0.075, 


0.566 


Tr. 


Exp . 


Event 


Zero 


Out. 


-0.290, 


-0.021, 


-0.198, 


-0.605" 


Int. 


Ind. 




i'i . ilr . 



ERIC 
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Multidinionnioivjl Scalinp; Solution rov Eighth Grade Control 
SubjGcts Eetention Te£il; Mean Relatedness Coefficient .Matrix 



i 





Final Configuration 
3 Dimensions Sl:ress = .O-'l-O 


Sorted 
I 


Configurations 
Dimension 
2 3 


Prb. 


0 . 3^1-9 , 


o.07ij. 


-O.Olb 


li.L. 


Zero 


E.L, 


Ind. 


— u • poo 5 




u • uoo 


Ind. 




Zero 


Event 


0.1/4.7, 


0.068, 


0.721 


Zero 


Ind. 


M.E. 


Zero 


-0./-t7/4, 


-1.039, 


-0.853 


Out. 


Event 


Int . 


E.L. 


0.096, 


0.572, 


-0.981 


Tr. 


Prb. 


Prb. 


Int. 


■ 1.299, 


-0.664, 


-0 . 160 


E.L. 


M.E. 


Ind. : 


Tr. 


-0.018, 


0.530, 


0.319 


Event 


Out . 


Tr. 


Exp. 


:0.23^4, 


0.602, 


0.942 


Exp. 


Tr. 


Out. 


W.E. 


-0.662, 


O.lll, 


-0.6''-i-9 


Er;b. 


E.L. 


Even t 


Out. 


-0.385, 


0.311, 


0.610 


Int . 


■ Exij . 


Exp,.' 



0 

ERIC 



f 

MulbicliifionGiona] Scalinfi; Solution for Hir^li School 
Experimental Siibjocl:^ Protor.:!; .Mcn.a 
Relatediiess Coerfi-^ient Fiatrix 





F in a 1 C cm f i gur a t i on 




Sor 1: e d Conf i guj.' at ions 




M- UimenB.i.ons Stress = . 


031 


Dimension 








125 


Fvh. 


-0.387, -0.586, -0.036, 


-0.856 


Zero Event Ind. Frb. 



Ind. -0.141, 0.664, -0.952, 0.142 Prb. Prb. M.E. E.L. 



Event 0.64^4-, -0.674, 0.547, 0.000 Exp. Zero Int. Tr. 



Zero 


-0.511, 


-0.540, 


0.022, 


0.849 


E.L.- 


E.L. 


E.L. 


Event 


E.L. 


-0.245, 


-0.540, 


-0.573, 


-O". 5A4 


Ind. 


Out. 


Prb. 


Exp. 


Int. 


0.438, 


0.556, 


-0.576, 


0.083 


M.E.' 


M.E, 


Zero 


Int . 


Tr: 


0.146, 


0.372, 


0 . 663 , 


-0.449 


Tr. 


Tr. 


Event 


O^ut. • 


Exp . 


-0.274, 


0.460, 


0.720, 


0.023 


Out. 


Exp. 


Tr . 


Ind. 


M.E. 


-0.009, 


0.277, 


-0.598 , 


0.6>-l-5 


Int. 


Int . 


Exp. 


M.E. 



Out. 0.341, 0.011, 0.763, 0.107 Event Ind. Out. Zero 



Muli;ldiitiojurio]ui I Scaling Solution Tor Jiif';.h School 
Expcriiiifint'.?! Sub "ioc bs Pon bi:os b V\eim 
Kolntodiiosfi CoG.fric'Jent rial.ri:-: 







Finwl Configuration 
4 Dimensions Stress = . 


027 


So:"ted Configurations 
Dimension 
1254 


Frh. 


0.077, 


-0.565, 


0.112, 


-0. 


O-'-l-S 


Zei'O 


E.L. 


Ind . 


Ind. 


Ind. 


-0.27!?, 


0.472, 


-0.797, 


-0. 


697 


0\it. . 


Zero 


M.S. 


Int. 


Event 


-0.363, 


-0.034, 


0-545, 


-0. 


547 


Event 


Prb . 


E.L. 


Event 


Zero 


-1.020, 


-0.554, 


-0.120, 


0. 


649 


Ind . ■ 


Event 


Int. 


E>rp. ■ 


E.L. 


0.230, 


-0.759, 


-0.556, 


0. 


19s 


f-I.E. 


Int . 


Zero 


Prb . 


Int. 


1.294, 


0.157, 


-0.274, 


-0. 


686 


Pro. 


E:cp. 


Prb. 


Out. 


Tr. 


0.151, 


0.570, 


0.659, 


0. 


158 


Tr. 


Out . : 


Out. 


JTr . ; 


Exp. 


0..067, 


; O.lbl, 


0.725, 


-0. 


1^7 


E.L. 


M.E., 


Event 


E.L. 


M.E. 


0.507, 


0.565, 


-0.611, 


0. 


896 


M.E.' 


Tr.. 


Tr. 


Zero 


Out. 


-0.^l49,' 


0.217, 


0.297, 


0. 


04^1- 


In i; . 


Ind. ■■ 




H.E. 



ISO 



liuIbldiJTiensional Scaling Sol'i'i;lo:n Tor High School 
E-xpo.riniL vttil Subjocb.s Porjttorrt; Modiaji 
KelaLeclness Coefficient Matrix. 







Fina 1 Conf igura t i on 
1 Diinenc-ion Stress = .012 


Sorted Configuration 
Dimension 
1 




0.675 


Zero 






Ind. 


Event 




M TP 


Zaro 


-1. w 


Int. ■ : 


E*L. 


0.757 . 


Out." 


Int- -, ^ 


■ . ■ ^ ■ ; , ■■ 0.16^-'' ' T 




Tr. ; 


'i L ■ 0.608 : 


: Event / ■ ■ 


Exp. 






Fi.E. 


-0.022; : ' ■ 

.r ■ - \- . ' '■ ■. ■ ' , 


: ■ ' , Prb. : ■■■ . ;'i 


Out • 


^ ,Q..b46: . - ■ : . ^ 





Hultld.i iiioiin.i orjal Scalinc; Solution Tor Ili{":h School 
Ex|;o;rif;u: r; l,ol Gul) joo i.r. Po ton*, ],om 'J>.'r:i- Morm 
Koloi:o(lner;s Coerricient Mat.rix 







J Con fif^ura Ij 
''j l)iiiien.'';j.on.'3 Litre 


i on 
= .006 


So.ftod 
1 


Conf iyu.fotionr; 
Diinenrrion 
2 5 




-0.521, 


-0 . l-^i Q , 


0.152 


Intl. . 


Zero 


Ind . 


Ind . 


-0.571, 


0 . 568 , 


-0.99^t- 


.Event 




Int. 


Event 


-0.522, 


-0.151, 


0.161 






Zero 


Zero 


0.189, 


-1.579, 


-0.100 


Tr. 


Event 


Frb . 


E.L. 


-0. , 


0.785, 


0.50/1- 


Out . 


Tr. 


Tr. 


Int;. 


i.^os, 


0.1/(0, 


-0.95-^1 


E>:p. 


Out. 


Out. 


Tr. 


-0.520, 


-0.128, 


0.157 


E.L. 


Int . 


E>rp. 


Ext.'. 


-0.515, 


-0.152, 


0.160 


Zei'o 


Fi.E. 


Event 


M.E. 


0.::'25, 


0.5/1/1 , 


0.955 


n.E. 


Ind. 


E.L. 


Out. 


-0.517, 


-0.127, 


0.160 


Int . 


E.L. 


N.E. 
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Mult.i clj,iriO)if>-i onol Scalinc So].u(; ion for ilijch ochool 
UxperinionL/il ovibjoct.?-* Rohontion TcrjI. Hodicui 
KoXatocbionn Coerriclont; Mal;:r:ix 







Finnl Gonrigurotion 
1 Dinionnionn Stress = .009 


Soi • t e d Con f i !.';ur a t j on g 
Dimension 
1 2 


Prb. 


1.021, 


-0.705 


Zoro 


E.L. 


Ind. 


-COO'I , 


0.681 


E.L. 


Zero 


Event 


O.OOG, 


o.e^ij) 


Exp . 


Prb. 


Zero 


-l.f>79. 




Tr. 


Int . 


E.L. 


-0./I6'!-, 


-1.^5^ 


Ind. 


Tr. 


Int. 


o.yi'i. 


-0.121 


Event' 


Exp. 


Tr. 


-0.178, 


0.286 


11. E. 


M.E. 


Eyp. 


-0.2^51, 


0.365 


OuL. 


Out . 


M.E. 


0.278, 


0.616 


Int. 


Evont; 


OuU 


0.^157 


0.655 




Ind. 
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Muil:i d i inonr-ionril Scnl.ui[5 Solution f.oT' Soliool Gonl;rol 

Subtioct;{-j Protor;!. Moan Rolalodjionrs Coo rric.i.on L Hakrix 







Finnl Configurotion 
2 Dimenpionf:' Stress = .025 


Soj'ted Con fi {jurat ion 
Dimension 
1 2 


X X ky • 


-0.670, 


0.516 


Zvpnt 


Zero 


Inrl 


-0.1/17, 


0.022 




E.L. 


J-iV Cll U 


-0.670, 


-0.761 


E.L. 


Event 


Zero 


-0.628, 


-1.027 


Zero 


Int. 


E.L. 


-o.ey;7, 


-0.819 


Ind. 


Out . 


Int. 


1.3^2, 


-0.474 


Tr. 


Ind. 


Tr. 


0.107, 


1.165; 


Ex]:i . 


Prb. 


Ebrp. 


0.127, 


1.118 


Out. 


ruE. 


M.E. 


0.380, 


0.551 


M.E. 


Exp . 


Out. 


0.297, 


-0.091 


int. 





fiubject;n Por/btenl. Henn Rclai-eciJieGri CooiTicienb Mal;rix 







Fin a 1 Goi tJ," i{;;ur u bi on 
4 Dimensions; SItgrs = . 


025 


Sorted Configm^'a lions 
DimonDion 
125^^ 




-0.114, 


-0.5.16, 


-0.006, 


-0. 


58^1- 


Fi.E. 


E.L. 


£• L • 


E.L. 




-o.:^i9, 


0.957, 


-0.158, 


0. 


18^!- 


Ind. 


Oul. 


M.E. 




Ev out 


-0.429, 


-0.056, 


O.7I8, 


-0. 


281 


Event 


Zero 


Int . 


Exp. 




0.219, 


-0.410, 


-0.0!>7, 


1. 


285 


E.L. 


Prb. 


Ind . 


Event 




-0.529, 


-0.5S1, 


-0.740, 


-0. 


651 


Prh. 


Event 


Zero 


Tr. 


Int. 


1.252, 


0.528, 


-0.250. 


0. 


509 


Out. 


Tr. 


Frh. 


Out. 


Tr. 


0.568, 


0.011, 


0.290, 


-0. 


257 


Zero 


Exp . 


Tr. 


Ind. 


Exp. 


0.257, 


0.108, 


0.417, 


-0. 


45^1 


E>rp. 


Int. 


Exp. 


Int. 


h.E. 


-o.GO!;, 




-0.721, 


0. 


426 


Tr. 


ri . E . 


Out. 


K.E.; 


Out. 


-0.079, 


-0.465, 


0.486, 


0. 


005 


Int . 


Ind. 


Event 


Zero 
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Haiti di]n(^ri:dor)n.l Scal.l.tj[.^ rjolul;:i.o.u Tor Ili|.';h School Conlji'ol 
Sul"^joctri Ro 1,01 it- ion Tent Moan Helatedrier.;r; Coc.r.riciont Tlatrix 







IMi: a 1 Con fifvurat i on 
5 Dimen.vionr, Stress = .037 


OUT liOCJ. 

1 


Conl'igurations 
Di.monsion 
2 5 


Prb. 


-0.2^9, 


-0.249, 


0.551 


E.L. 


Zero 


Int. 


Ind. 


0.768, 


1.05:;^, 


-0.154 


Event 


Out. 


E.L. 


Event 


-O.450, 


-0.118, 


0.578 


Out . 


Prb. 


11. E. 


Zero 


1.051, 


-0.815, 


-0.578 


Tr. 


Int. 


Zero 


E.L. 


-o.58::>. 


0.059, 


-0.909 


Frb. 


Event 


Ind. 


Int. 


0.109, 


-0.149, 


--/.210 


Exi.-.. 


Tr. 


Prb. 


Tr. 


-0.252, 


-0.066, 


0.775 


W.E. 


Exp. 


Event 


Exi). 


-0.160, 


-0.060, 


0.654 


Int. 


E.L. 


Exp. 


M.E. 


0.089, 


C.660, 


-0.691 


Ind. 


M.S. 


Tr. 


Out;. 


-O.5IS, 


■ -0.277, 


0.786 


Zero 


Ind. 


Out . 



186 



Mult j.diiiionGioiinl Sculirif'; Solution for K:L['jli ScIjooI Gonbrol 
Subjects Koiont;io,ii Test Mocin an l.-;elate(]i'ior;r. GooJ'ricient Mnl;rix 





F inn]- Con .C i r a t :i. on 
2 .Dimensiotir; Sti'-ess = .010 


Sorted Con f i gur a t i on s 
Dimension 
1 2 


Prb. 


0.75?, 


0,.55l 


Zoj:'0 


E.L. 


Ind... 


-(}..504 , 


0.575 


Ind. 


M.E. 


Event; 




0 . 568 


Event 


Zero 


Zero 


-1-518, 


-0 . 928 


Out . 


Ouij . 


E.L. 


0.975, 


-1.489 




Prb. 


Int. 


0.29-'! , 


0.717 


i i. m -Ui • 


Event 


Tr. 


-0.0S2, 


0.928 


Exp. 


Ind. 


Bxi^ . 


0.099, 


0.851 


I.nt . 


Int . 


M.E. 


0.059, 


-0.951 


Prb. 


Ex !.■> . 


Out . 


-0.215, 


-0.221 


E.L. 


Tr. 



Niiltii cijjnoM.^.n.oiinl Scaling; Solul;:io?i I'or Paraj.?:rap}i 
Conr;i,:runl..i on Dnh/i Cixt.h G.i'ado Ey/fiorirnon LmI Bubjocbn 







F.lnal Conl j.gurati on 
''I- JJiniojinioj"!;; StroGP = . 


031 


Sort 
1 


ed Confifiurations 
Diiiioiision 
2 5 ^1- 




0.24;., -0.2:31, 0.791, 


-0.3B9 




Event 


E.L. 


Tp. 


Ind. 


-0.^175, 0.932, -0.099, 


0.409 


Ind. 


Zei'O 


Int. 


Int . 


Event- 


0.089, -0.709, 0.565, 


-0.063 


XJ^'^ [ ■ . 


E.L. 


Zoi'O 


Prb. 


Zero 


-0.941, -0.57r2, -0.529, 


0.037 


Out . 


Prb. 


li.E. 


Event 



E.L. -0.046, -0.515, -0.936, -0.023 E.L. H.E. Ind. E.L. 



Int. 0.5B8, 0.030, -0.627, -0.674 Event Int. Tr. Exp. 



Tr. 


0.400, 


0. 


495, 


0.223, 


-0 . 688 


Prb. 


Out. 


Out. 


Zero 


Exj) . 


-0.185, 


0. 


/|47, 


0.545, 


0.011 


T.f. 


Exp . 


Exj-i . 


Out . 


M.E. 


0.468,- 


0. 


017, 


-0.221, 


1.118 


M.E. 


Tr. 


Event 


Ind. 


Out. 


-0.143, 


0. 


126, 


0.291, 


0.261 


Int. 


Ind. 


Fx'b . 


r.-; V 

1 1 . XJ . 



:i.88 



Multidiirio.li ri orial Soalinn; Soluhion. i'or Pan:'afi;rnph 
CorK?t;ruct:i.on Dotn Eightli Grade ExpGrimeii tal Subjects 







Fj.na 1 Conripjiiration. 
5 Dimonsions Sbress =. .060 


Sorted 
1 


Conf i gui^a t i o n s 
Dimension 
2 3 


Prb. 


0 . •'1-90 , 


- 1.052 , 


0.567 


E • Lj • 


Prb . 


M.E. 


Ind. 


-0. lOd , 


• 0.662, 


-0 . 599 


Zero 


M . E . 


E.L* 


Event 


0.011, 


-0.151, 


0.504 


Out. 


E.L. 


Ind. 


Zero 


-0.7^-!0, 


-0.555, 


0.174 


Ind. 


Zero 


Out . 


E.L. 


-0 .866 , 


-0.550, 


-0.6.51 


Tr. 


Out. 


Int . 


Int. 


0.993, 


0.879, 


0.150 


Event 


Event 


Zero 


Tr. 


-0.053, 


0.859, 


0.705 


■Ex]p. 


Exp . 


Event 


Exp. 


0.223, 


0.159, 


0.880 


H.E. 


Ind. 


Prb. 


H.E. 




-0.399, 


-1.105 




Tr. 





Out. -O.3SI, -C.29I, -0.224 Int. Int. 
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riultidiTiioTi.siojial Scaling Solution for Pai'agraph 
Construction Data Eighuh Grade Control Subjects 







1 ' i n a ]. Const" rue t :i. o n 
2 Dimensions Stress = .060 


Sorto 
1 


d Configurations 
Dimension 

2 


X U • 


-0.709, 


-0.965 


1 i • iZ; • 


1 r 13 . 


T -n ri 


-0.967, 


. 0.066 


Ind. • 


Zero 


nil/ T-iT'i "i" 


-0.098, 


0.542 


Irl U • 




Zero 


0.95.^3, 


-0.728 


Event 


Out. 


E.L. 


0.176, 


-0.186 


Tr. 


E.L. . 


Int. 


1./147, 


1.061 


, E>:p. 


Ind. 


Tr. 


0.058, 


■ 0.545 


E.L. 


M.E. 


Exp. 


0.060, 


-0.425 


Out. 


Event 


Fl.E. 


-1.5^-!9, 


0.296 


Zero 





Out. 0.448, -0.209 Int. Int. 
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M\.iltid:i.iiun.ir;.:Lo]ial Scal.inf;!; Sol\it::i on. J'or Pn.rograph 
Coji.siruot:L on Da I !:Lr;]i kx I] ool Expo.i 'iuion i;a 1 Sub j e c t r. 







Finn 1 CorLri(';uration 
3 DiriieJir:;io.nr.; Strocc = .036 


Sorl;od 
1 


Con f.i. giara t j. on s 
]Ji men si on 
2 5 


X X 0 • 


-0.528, 


-0.^i-5^i-, 


-0.040 




E.L. 


Int. 


xnci. 


-0.135, 


1.149, 


0.182 


1. 1 • 


Int. 


Zero 


Event 


0.097, 


-0.^1^6, 


0.532 




Event 


Exp. 


2 01*0 


-0.565, 


-0.071, 


-0.781 


E>cp • 


Pi^b . 


Prb. 


E.L. 


-0.103, 


-1.300, 


0.204 


Ind. 


Zero 


Out. 


I]rt . 


1.101, 


-0.498, 


-0.793 


E.L. 


M.E. 


Ind. 


Tr. 


. -0.5^13, 


1.023, 


• 0.345,. 


Out . 


Out . 


E.L. 


Exp. 


-0.170, 


0.410, 


-0.278 


Even t 


E>cp. 


Tr . 


M.E. 


0.808, 


-0.021, 


0.631 


I': . E . 




Event 


Out. 


0.038, 


0.245, 


-0.003 


Int . 


Ind. 


M.E. 
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Mul l; Lct:LincMir;.ioriol Sca].inn; Solu. l;:l.o.[i for Pa:r^ag.■^n,J)h 
Con 5tx"j.ci;.i.o,M Lata 111^11 Bciiool Control ?iiibjectr> 
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Tlio vippo.v 1;rianp;iilQr portion oT oach mobrix roportod 
in thin nocl ion in Uie upper brimigulnr porldon of a medioii 
RC matrix. The lower triangular portion ol oacli matrix 
correGpondn to the lower kriatipular port;Jon oJ a moan RC 
matrix. (Woto t;hat every modion/mcan RC matrix in nyirurietric. ) 
Diagonal elcMnojitn or cacli modian/mcan RC matrix are 1.0, but; 
are deleted in this isection Tor clarity of j)resentation. 
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1'. • Hr • 


Out . 


p. 




0 


191 


0 


0 


0 


191 


191 


0 


■ 143 


I. ^ 


029 




0 


0 


0 




0 


0 


043 


0 


Ev. 


245 


007 




0 


; 0 ^ 


0 


511 


476 


0 : 


-283 


Z. 


0^1-6 


023 


022 




014 


/028 


0 


012 


039 


. 0 


E.L. 


067 


. 023 


079 


039 




' 022 


.0 


005 


168 


0 


In. 


031 


. 038 


006 


067 


107 




0 


0 ' 


057 


0 


Tr. 


313 


0 


518 


017 


0^-8 


0 




548 


0 


122 


Exp. 


265 


0 


595 


035. 


0^-!l 


045 


' 487 




0 


179 


M.E. 


086 


160 


090 


038 


175 


096 


044 


■059 ■ 




0 


Out. 


25^(- 


Oil 


25s 


0Q6 


043 


C 


Pip 


265 


020 





ERIC 



